2023-02-13 10:07:55,079 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-13 10:07:55,278 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e 2023-02-13 10:07:55,292 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-13 10:07:55,292 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b, deleteOnExit=true 2023-02-13 10:07:55,293 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 10:07:55,293 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/test.cache.data in system properties and HBase conf 2023-02-13 10:07:55,294 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 10:07:55,294 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/hadoop.log.dir in system properties and HBase conf 2023-02-13 10:07:55,295 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 10:07:55,296 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 10:07:55,296 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 10:07:55,390 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 10:07:55,743 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 10:07:55,746 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 10:07:55,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 10:07:55,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 10:07:55,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 10:07:55,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 10:07:55,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 10:07:55,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 10:07:55,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 10:07:55,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 10:07:55,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/nfs.dump.dir in system properties and HBase conf 2023-02-13 10:07:55,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/java.io.tmpdir in system properties and HBase conf 2023-02-13 10:07:55,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 10:07:55,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 10:07:55,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 10:07:56,163 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 10:07:56,166 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 10:07:56,611 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 10:07:56,783 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 10:07:56,795 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 10:07:56,827 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 10:07:56,857 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/java.io.tmpdir/Jetty_localhost_localdomain_41905_hdfs____.dh8yx1/webapp 2023-02-13 10:07:56,982 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41905 2023-02-13 10:07:57,017 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 10:07:57,017 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 10:07:57,572 WARN [Listener at localhost.localdomain/34273] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 10:07:57,689 WARN [Listener at localhost.localdomain/34273] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 10:07:57,710 WARN [Listener at localhost.localdomain/34273] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 10:07:57,717 INFO [Listener at localhost.localdomain/34273] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 10:07:57,723 INFO [Listener at localhost.localdomain/34273] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/java.io.tmpdir/Jetty_localhost_42053_datanode____ax6np3/webapp 2023-02-13 10:07:57,837 INFO [Listener at localhost.localdomain/34273] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42053 2023-02-13 10:07:58,200 WARN [Listener at localhost.localdomain/39579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 10:07:59,030 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d342104841e47d6: Processing first storage report for DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e from datanode 8cc9e15e-da6d-4d2a-b34f-70a90b09d31e 2023-02-13 10:07:59,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d342104841e47d6: from storage DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e node DatanodeRegistration(127.0.0.1:44661, datanodeUuid=8cc9e15e-da6d-4d2a-b34f-70a90b09d31e, infoPort=33203, infoSecurePort=0, ipcPort=39579, storageInfo=lv=-57;cid=testClusterID;nsid=927239843;c=1676282876222), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 10:07:59,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d342104841e47d6: Processing first storage report for DS-4025237e-fc5d-4467-9761-c856279bc639 from datanode 8cc9e15e-da6d-4d2a-b34f-70a90b09d31e 2023-02-13 10:07:59,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d342104841e47d6: from storage DS-4025237e-fc5d-4467-9761-c856279bc639 node DatanodeRegistration(127.0.0.1:44661, datanodeUuid=8cc9e15e-da6d-4d2a-b34f-70a90b09d31e, infoPort=33203, infoSecurePort=0, ipcPort=39579, storageInfo=lv=-57;cid=testClusterID;nsid=927239843;c=1676282876222), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 10:07:59,105 DEBUG [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e 2023-02-13 10:07:59,170 INFO [Listener at localhost.localdomain/39579] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/zookeeper_0, clientPort=57475, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 10:07:59,186 INFO [Listener at localhost.localdomain/39579] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57475 2023-02-13 10:07:59,194 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:07:59,196 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:07:59,835 INFO [Listener at localhost.localdomain/39579] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc with version=8 2023-02-13 10:07:59,835 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/hbase-staging 2023-02-13 10:08:00,275 INFO [Listener at localhost.localdomain/39579] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 10:08:00,830 INFO [Listener at localhost.localdomain/39579] client.ConnectionUtils(127): master/jenkins-hbase16:0 server-side Connection retries=3 2023-02-13 10:08:00,870 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:00,871 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:00,871 INFO [Listener at localhost.localdomain/39579] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 10:08:00,871 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:00,871 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 10:08:01,061 INFO [Listener at localhost.localdomain/39579] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 10:08:01,149 DEBUG [Listener at localhost.localdomain/39579] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 10:08:01,282 INFO [Listener at localhost.localdomain/39579] ipc.NettyRpcServer(120): Bind to /188.40.62.62:42277 2023-02-13 10:08:01,295 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:01,297 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:01,321 INFO [Listener at localhost.localdomain/39579] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42277 connecting to ZooKeeper ensemble=127.0.0.1:57475 2023-02-13 10:08:01,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:422770x0, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 10:08:01,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42277-0x100525c4b260000 connected 2023-02-13 10:08:01,526 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 10:08:01,527 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 10:08:01,532 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 10:08:01,542 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42277 2023-02-13 10:08:01,543 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42277 2023-02-13 10:08:01,543 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42277 2023-02-13 10:08:01,548 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42277 2023-02-13 10:08:01,550 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42277 2023-02-13 10:08:01,558 INFO [Listener at localhost.localdomain/39579] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc, hbase.cluster.distributed=false 2023-02-13 10:08:01,623 INFO [Listener at localhost.localdomain/39579] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=3 2023-02-13 10:08:01,623 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:01,624 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:01,624 INFO [Listener at localhost.localdomain/39579] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 10:08:01,624 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 10:08:01,624 INFO [Listener at localhost.localdomain/39579] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 10:08:01,628 INFO [Listener at localhost.localdomain/39579] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 10:08:01,631 INFO [Listener at localhost.localdomain/39579] ipc.NettyRpcServer(120): Bind to /188.40.62.62:38311 2023-02-13 10:08:01,633 INFO [Listener at localhost.localdomain/39579] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 10:08:01,638 DEBUG [Listener at localhost.localdomain/39579] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 10:08:01,639 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:01,642 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:01,643 INFO [Listener at localhost.localdomain/39579] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38311 connecting to ZooKeeper ensemble=127.0.0.1:57475 2023-02-13 10:08:01,650 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:383110x0, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 10:08:01,651 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): regionserver:383110x0, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 10:08:01,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38311-0x100525c4b260001 connected 2023-02-13 10:08:01,652 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 10:08:01,653 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 10:08:01,654 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38311 2023-02-13 10:08:01,654 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38311 2023-02-13 10:08:01,656 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38311 2023-02-13 10:08:01,658 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38311 2023-02-13 10:08:01,658 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38311 2023-02-13 10:08:01,660 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:01,675 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 10:08:01,676 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:01,699 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 10:08:01,699 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 10:08:01,700 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:01,700 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 10:08:01,702 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase16.apache.org,42277,1676282880018 from backup master directory 2023-02-13 10:08:01,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 10:08:01,708 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:01,708 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 10:08:01,709 WARN [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 10:08:01,709 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:01,712 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 10:08:01,714 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 10:08:02,200 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/hbase.id with ID: fa77de40-ca76-4ca8-b677-969787d47313 2023-02-13 10:08:02,243 INFO [master/jenkins-hbase16:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:02,291 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:02,735 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3e09e819 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:02,798 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e0830d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:02,815 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 10:08:02,817 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 10:08:02,830 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 10:08:02,830 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 10:08:02,832 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 10:08:02,835 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 10:08:02,836 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 10:08:02,862 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store-tmp 2023-02-13 10:08:03,297 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:03,297 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 10:08:03,297 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:08:03,298 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:08:03,298 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 10:08:03,298 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:08:03,298 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:08:03,298 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676282883297Disabling compacts and flushes for region at 1676282883297Disabling writes for close at 1676282883298 (+1 ms)Writing region close event to WAL at 1676282883298Closed at 1676282883298 2023-02-13 10:08:03,300 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/WALs/jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:03,317 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C42277%2C1676282880018, suffix=, logDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/WALs/jenkins-hbase16.apache.org,42277,1676282880018, archiveDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/oldWALs, maxLogs=10 2023-02-13 10:08:03,362 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK] 2023-02-13 10:08:03,369 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 10:08:03,419 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/WALs/jenkins-hbase16.apache.org,42277,1676282880018/jenkins-hbase16.apache.org%2C42277%2C1676282880018.1676282883326 2023-02-13 10:08:03,420 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK]] 2023-02-13 10:08:03,420 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:03,421 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:03,423 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,424 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,475 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,482 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 10:08:03,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 10:08:03,518 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:03,524 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,526 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,541 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 10:08:03,545 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:03,546 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61099544, jitterRate=-0.0895458459854126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:03,547 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676282883446Initializing all the Stores at 1676282883449 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676282883449Cleaning up temporary data from old regions at 1676282883531 (+82 ms)Cleaning up detritus from prior splits at 1676282883533 (+2 ms)Region opened successfully at 1676282883547 (+14 ms) 2023-02-13 10:08:03,548 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 10:08:03,565 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 10:08:03,565 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 10:08:03,567 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 10:08:03,568 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 10:08:03,595 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 26 msec 2023-02-13 10:08:03,595 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 10:08:03,615 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 10:08:03,620 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 10:08:03,639 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 10:08:03,642 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 10:08:03,644 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 10:08:03,648 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 10:08:03,652 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 10:08:03,699 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:03,701 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 10:08:03,701 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 10:08:03,715 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 10:08:03,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 10:08:03,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 10:08:03,725 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:03,725 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase16.apache.org,42277,1676282880018, sessionid=0x100525c4b260000, setting cluster-up flag (Was=false) 2023-02-13 10:08:03,749 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:03,774 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 10:08:03,776 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:03,791 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:03,816 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 10:08:03,818 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:03,820 WARN [master/jenkins-hbase16:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp 2023-02-13 10:08:03,864 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(952): ClusterId : fa77de40-ca76-4ca8-b677-969787d47313 2023-02-13 10:08:03,867 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 10:08:03,876 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 10:08:03,876 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 10:08:03,884 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 10:08:03,885 DEBUG [RS:0;jenkins-hbase16:38311] zookeeper.ReadOnlyZKClient(139): Connect 0x2a8c0357 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:03,892 DEBUG [RS:0;jenkins-hbase16:38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@244be876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:03,893 DEBUG [RS:0;jenkins-hbase16:38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20746827, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-02-13 10:08:03,911 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase16:38311 2023-02-13 10:08:03,914 INFO [RS:0;jenkins-hbase16:38311] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 10:08:03,914 INFO [RS:0;jenkins-hbase16:38311] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 10:08:03,914 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 10:08:03,915 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 10:08:03,916 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase16.apache.org,42277,1676282880018 with isa=jenkins-hbase16.apache.org/188.40.62.62:38311, startcode=1676282881622 2023-02-13 10:08:03,923 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 10:08:03,923 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 10:08:03,923 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 10:08:03,923 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 10:08:03,923 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase16:0, corePoolSize=10, maxPoolSize=10 2023-02-13 10:08:03,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:03,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-02-13 10:08:03,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:03,925 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676282913925 2023-02-13 10:08:03,926 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 10:08:03,931 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 10:08:03,931 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 10:08:03,932 DEBUG [RS:0;jenkins-hbase16:38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 10:08:03,937 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 10:08:03,937 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 10:08:03,943 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 10:08:03,944 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 10:08:03,944 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 10:08:03,944 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 10:08:03,948 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:03,949 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 10:08:03,950 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 10:08:03,951 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 10:08:03,953 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 10:08:03,953 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 10:08:03,956 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676282883955,5,FailOnTimeoutGroup] 2023-02-13 10:08:03,956 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676282883956,5,FailOnTimeoutGroup] 2023-02-13 10:08:03,956 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:03,956 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 10:08:03,957 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:03,958 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:03,970 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:03,972 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:03,972 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc 2023-02-13 10:08:03,989 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:56697, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 10:08:04,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,014 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc 2023-02-13 10:08:04,014 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:34273 2023-02-13 10:08:04,014 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 10:08:04,024 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 10:08:04,025 DEBUG [RS:0;jenkins-hbase16:38311] zookeeper.ZKUtil(162): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,025 WARN [RS:0;jenkins-hbase16:38311] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 10:08:04,026 INFO [RS:0;jenkins-hbase16:38311] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 10:08:04,026 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/WALs/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,027 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,38311,1676282881622] 2023-02-13 10:08:04,038 DEBUG [RS:0;jenkins-hbase16:38311] zookeeper.ZKUtil(162): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,049 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 10:08:04,058 INFO [RS:0;jenkins-hbase16:38311] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 10:08:04,074 INFO [RS:0;jenkins-hbase16:38311] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 10:08:04,077 INFO [RS:0;jenkins-hbase16:38311] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:08:04,077 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,078 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 10:08:04,084 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,084 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,085 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,086 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,086 DEBUG [RS:0;jenkins-hbase16:38311] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 10:08:04,087 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,087 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,087 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,100 INFO [RS:0;jenkins-hbase16:38311] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 10:08:04,102 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,38311,1676282881622-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:04,115 INFO [RS:0;jenkins-hbase16:38311] regionserver.Replication(203): jenkins-hbase16.apache.org,38311,1676282881622 started 2023-02-13 10:08:04,115 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1638): Serving as jenkins-hbase16.apache.org,38311,1676282881622, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:38311, sessionid=0x100525c4b260001 2023-02-13 10:08:04,115 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 10:08:04,115 DEBUG [RS:0;jenkins-hbase16:38311] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,115 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,38311,1676282881622' 2023-02-13 10:08:04,116 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:04,116 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:04,117 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 10:08:04,117 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 10:08:04,117 DEBUG [RS:0;jenkins-hbase16:38311] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,117 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,38311,1676282881622' 2023-02-13 10:08:04,117 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 10:08:04,118 DEBUG [RS:0;jenkins-hbase16:38311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 10:08:04,118 DEBUG [RS:0;jenkins-hbase16:38311] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 10:08:04,118 INFO [RS:0;jenkins-hbase16:38311] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 10:08:04,118 INFO [RS:0;jenkins-hbase16:38311] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 10:08:04,235 INFO [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C38311%2C1676282881622, suffix=, logDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/WALs/jenkins-hbase16.apache.org,38311,1676282881622, archiveDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/oldWALs, maxLogs=32 2023-02-13 10:08:04,251 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK] 2023-02-13 10:08:04,256 INFO [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/WALs/jenkins-hbase16.apache.org,38311,1676282881622/jenkins-hbase16.apache.org%2C38311%2C1676282881622.1676282884237 2023-02-13 10:08:04,256 DEBUG [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK]] 2023-02-13 10:08:04,389 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:04,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 10:08:04,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/info 2023-02-13 10:08:04,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 10:08:04,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 10:08:04,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 10:08:04,404 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 10:08:04,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 10:08:04,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/table 2023-02-13 10:08:04,408 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 10:08:04,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,410 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740 2023-02-13 10:08:04,411 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740 2023-02-13 10:08:04,414 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 10:08:04,416 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 10:08:04,419 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:04,420 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64724377, jitterRate=-0.035531625151634216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 10:08:04,420 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676282884390Initializing all the Stores at 1676282884392 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676282884392Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676282884392Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676282884393 (+1 ms)Cleaning up temporary data from old regions at 1676282884412 (+19 ms)Cleaning up detritus from prior splits at 1676282884413 (+1 ms)Region opened successfully at 1676282884420 (+7 ms) 2023-02-13 10:08:04,420 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 10:08:04,420 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 10:08:04,420 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 10:08:04,420 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 10:08:04,420 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 10:08:04,421 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 10:08:04,421 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676282884420Disabling compacts and flushes for region at 1676282884420Disabling writes for close at 1676282884420Writing region close event to WAL at 1676282884421 (+1 ms)Closed at 1676282884421 2023-02-13 10:08:04,426 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 10:08:04,426 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 10:08:04,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 10:08:04,446 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 10:08:04,449 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 10:08:04,602 DEBUG [jenkins-hbase16:42277] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-13 10:08:04,607 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,38311,1676282881622, state=OPENING 2023-02-13 10:08:04,649 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 10:08:04,658 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:04,659 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 10:08:04,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:04,853 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:04,855 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 10:08:04,858 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:42528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 10:08:04,869 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 10:08:04,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 10:08:04,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C38311%2C1676282881622.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/WALs/jenkins-hbase16.apache.org,38311,1676282881622, archiveDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/oldWALs, maxLogs=32 2023-02-13 10:08:04,893 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK] 2023-02-13 10:08:04,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/WALs/jenkins-hbase16.apache.org,38311,1676282881622/jenkins-hbase16.apache.org%2C38311%2C1676282881622.meta.1676282884876.meta 2023-02-13 10:08:04,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44661,DS-d6c2a07f-e10b-4c2b-af15-c6b0660fee2e,DISK]] 2023-02-13 10:08:04,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:04,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 10:08:04,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 10:08:04,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 10:08:04,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 10:08:04,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:04,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 10:08:04,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 10:08:04,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 10:08:04,928 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/info 2023-02-13 10:08:04,928 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/info 2023-02-13 10:08:04,929 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 10:08:04,930 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,930 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 10:08:04,931 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 10:08:04,931 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/rep_barrier 2023-02-13 10:08:04,932 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 10:08:04,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 10:08:04,935 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/table 2023-02-13 10:08:04,935 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/table 2023-02-13 10:08:04,935 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 10:08:04,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:04,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740 2023-02-13 10:08:04,942 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740 2023-02-13 10:08:04,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 10:08:04,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 10:08:04,949 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72926469, jitterRate=0.0866890698671341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 10:08:04,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676282884924Writing region info on filesystem at 1676282884924Initializing all the Stores at 1676282884926 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676282884926Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676282884926Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676282884926Cleaning up temporary data from old regions at 1676282884943 (+17 ms)Cleaning up detritus from prior splits at 1676282884944 (+1 ms)Running coprocessor post-open hooks at 1676282884949 (+5 ms)Region opened successfully at 1676282884949 2023-02-13 10:08:04,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676282884847 2023-02-13 10:08:04,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 10:08:04,974 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 10:08:04,974 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,38311,1676282881622, state=OPEN 2023-02-13 10:08:04,983 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 10:08:04,983 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 10:08:04,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 10:08:04,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,38311,1676282881622 in 321 msec 2023-02-13 10:08:04,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 10:08:04,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 554 msec 2023-02-13 10:08:05,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1420 sec 2023-02-13 10:08:05,001 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676282881688, completionTime=-1 2023-02-13 10:08:05,001 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-13 10:08:05,002 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 10:08:05,053 DEBUG [hconnection-0x63953456-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:05,057 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:42540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:05,073 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-13 10:08:05,073 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676282945073 2023-02-13 10:08:05,073 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676283005073 2023-02-13 10:08:05,074 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 71 msec 2023-02-13 10:08:05,111 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,42277,1676282880018-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:05,112 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,42277,1676282880018-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:05,112 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,42277,1676282880018-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:05,114 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase16:42277, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:05,114 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 10:08:05,121 DEBUG [master/jenkins-hbase16:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 10:08:05,131 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 10:08:05,132 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 10:08:05,144 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 10:08:05,147 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:05,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:05,180 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,183 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8 empty. 2023-02-13 10:08:05,183 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 10:08:05,213 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:05,216 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => bd73e34f431932d74e40a406e256a3a8, NAME => 'hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:05,232 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:05,232 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing bd73e34f431932d74e40a406e256a3a8, disabling compactions & flushes 2023-02-13 10:08:05,232 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,232 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,232 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. after waiting 0 ms 2023-02-13 10:08:05,232 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,232 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,233 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for bd73e34f431932d74e40a406e256a3a8: Waiting for close lock at 1676282885232Disabling compacts and flushes for region at 1676282885232Disabling writes for close at 1676282885232Writing region close event to WAL at 1676282885232Closed at 1676282885232 2023-02-13 10:08:05,238 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:05,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676282885242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282885242"}]},"ts":"1676282885242"} 2023-02-13 10:08:05,286 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:08:05,288 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:05,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282885288"}]},"ts":"1676282885288"} 2023-02-13 10:08:05,298 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 10:08:05,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bd73e34f431932d74e40a406e256a3a8, ASSIGN}] 2023-02-13 10:08:05,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bd73e34f431932d74e40a406e256a3a8, ASSIGN 2023-02-13 10:08:05,359 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bd73e34f431932d74e40a406e256a3a8, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:05,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bd73e34f431932d74e40a406e256a3a8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:05,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676282885511"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282885511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282885511"}]},"ts":"1676282885511"} 2023-02-13 10:08:05,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bd73e34f431932d74e40a406e256a3a8, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:05,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,684 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bd73e34f431932d74e40a406e256a3a8, NAME => 'hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:05,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:05,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,691 INFO [StoreOpener-bd73e34f431932d74e40a406e256a3a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,695 DEBUG [StoreOpener-bd73e34f431932d74e40a406e256a3a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/info 2023-02-13 10:08:05,695 DEBUG [StoreOpener-bd73e34f431932d74e40a406e256a3a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/info 2023-02-13 10:08:05,697 INFO [StoreOpener-bd73e34f431932d74e40a406e256a3a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd73e34f431932d74e40a406e256a3a8 columnFamilyName info 2023-02-13 10:08:05,699 INFO [StoreOpener-bd73e34f431932d74e40a406e256a3a8-1] regionserver.HStore(310): Store=bd73e34f431932d74e40a406e256a3a8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:05,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:08:05,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:05,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened bd73e34f431932d74e40a406e256a3a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65641561, jitterRate=-0.021864518523216248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:05,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for bd73e34f431932d74e40a406e256a3a8: Running coprocessor pre-open hook at 1676282885688Writing region info on filesystem at 1676282885688Initializing all the Stores at 1676282885690 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676282885690Cleaning up temporary data from old regions at 1676282885710 (+20 ms)Cleaning up detritus from prior splits at 1676282885711 (+1 ms)Running coprocessor post-open hooks at 1676282885732 (+21 ms)Region opened successfully at 1676282885732 2023-02-13 10:08:05,735 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8., pid=6, masterSystemTime=1676282885674 2023-02-13 10:08:05,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,744 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:08:05,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bd73e34f431932d74e40a406e256a3a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:05,746 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676282885744"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282885744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282885744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282885744"}]},"ts":"1676282885744"} 2023-02-13 10:08:05,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 10:08:05,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bd73e34f431932d74e40a406e256a3a8, server=jenkins-hbase16.apache.org,38311,1676282881622 in 234 msec 2023-02-13 10:08:05,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 10:08:05,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bd73e34f431932d74e40a406e256a3a8, ASSIGN in 404 msec 2023-02-13 10:08:05,764 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:05,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282885766"}]},"ts":"1676282885766"} 2023-02-13 10:08:05,770 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 10:08:05,809 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:05,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 676 msec 2023-02-13 10:08:05,852 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 10:08:05,859 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 10:08:05,859 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:08:05,907 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 10:08:05,941 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 10:08:05,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 59 msec 2023-02-13 10:08:05,962 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 10:08:05,982 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 10:08:05,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 32 msec 2023-02-13 10:08:06,024 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 10:08:06,041 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 10:08:06,041 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 4.332sec 2023-02-13 10:08:06,043 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 10:08:06,045 INFO [master/jenkins-hbase16:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 10:08:06,045 INFO [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 10:08:06,046 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,42277,1676282880018-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 10:08:06,048 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,42277,1676282880018-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 10:08:06,067 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 10:08:06,071 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(139): Connect 0x0bf9b76d to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:06,084 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@557683e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:06,102 DEBUG [hconnection-0x4a51814c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:06,143 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:42548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:06,155 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:08:06,157 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(139): Connect 0x37d84738 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:06,169 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d5617ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:06,170 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:08:06,202 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=168, AvailableMemoryMB=6726 2023-02-13 10:08:06,213 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:06,219 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:06,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:08:06,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:06,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:06,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:06,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-13 10:08:06,250 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:06,254 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b empty. 2023-02-13 10:08:06,257 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:06,257 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-13 10:08:06,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 10:08:06,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 10:08:06,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 10:08:06,691 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:06,693 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => f92606d2b350e4ac8e2f20872f822e8b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing f92606d2b350e4ac8e2f20872f822e8b, disabling compactions & flushes 2023-02-13 10:08:06,707 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. after waiting 0 ms 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:06,707 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:06,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for f92606d2b350e4ac8e2f20872f822e8b: Waiting for close lock at 1676282886707Disabling compacts and flushes for region at 1676282886707Disabling writes for close at 1676282886707Writing region close event to WAL at 1676282886707Closed at 1676282886707 2023-02-13 10:08:06,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:06,714 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282886713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282886713"}]},"ts":"1676282886713"} 2023-02-13 10:08:06,716 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:08:06,717 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:06,718 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282886718"}]},"ts":"1676282886718"} 2023-02-13 10:08:06,720 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-13 10:08:06,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, ASSIGN}] 2023-02-13 10:08:06,770 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, ASSIGN 2023-02-13 10:08:06,773 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:06,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 10:08:06,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:06,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282886925"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282886925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282886925"}]},"ts":"1676282886925"} 2023-02-13 10:08:06,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:07,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:07,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f92606d2b350e4ac8e2f20872f822e8b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:07,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:07,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,102 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,104 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:07,104 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:07,107 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f92606d2b350e4ac8e2f20872f822e8b columnFamilyName family1 2023-02-13 10:08:07,110 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(310): Store=f92606d2b350e4ac8e2f20872f822e8b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:07,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:07,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:07,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened f92606d2b350e4ac8e2f20872f822e8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73265049, jitterRate=0.09173430502414703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:07,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for f92606d2b350e4ac8e2f20872f822e8b: Running coprocessor pre-open hook at 1676282887099Writing region info on filesystem at 1676282887099Initializing all the Stores at 1676282887101 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282887101Cleaning up temporary data from old regions at 1676282887114 (+13 ms)Cleaning up detritus from prior splits at 1676282887115 (+1 ms)Running coprocessor post-open hooks at 1676282887125 (+10 ms)Region opened successfully at 1676282887125 2023-02-13 10:08:07,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., pid=11, masterSystemTime=1676282887089 2023-02-13 10:08:07,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:07,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:07,131 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:07,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282887131"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282887131"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282887131"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282887131"}]},"ts":"1676282887131"} 2023-02-13 10:08:07,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 10:08:07,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 202 msec 2023-02-13 10:08:07,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-13 10:08:07,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, ASSIGN in 371 msec 2023-02-13 10:08:07,143 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:07,143 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282887143"}]},"ts":"1676282887143"} 2023-02-13 10:08:07,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-13 10:08:07,184 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:07,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 947 msec 2023-02-13 10:08:07,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 10:08:07,381 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-13 10:08:07,403 DEBUG [hconnection-0x1926899e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:07,406 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:42550, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:07,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:07,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,649 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:07,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:07,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:07,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:07,650 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,650 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,682 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:07,682 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:07,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:07,683 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:07,683 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:07,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:07,691 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:07,691 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:07,692 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:07,692 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:07,693 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:07,693 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:07,695 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:07,696 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:08:08,287 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c1887c0d74064014b308209fc3181ddd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c1887c0d74064014b308209fc3181ddd 2023-02-13 10:08:08,704 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/2347dd782d96472b95993509bb49d484 2023-02-13 10:08:08,719 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/2347dd782d96472b95993509bb49d484 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484 2023-02-13 10:08:08,729 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-13 10:08:08,732 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 1036ms, sequenceid=5, compaction requested=false 2023-02-13 10:08:08,733 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:08,736 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:08,736 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:08,736 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:08,737 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:08,737 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,737 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:08,737 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:08,749 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,749 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:08,750 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,750 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:08,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:08,753 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:08,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@225d77ce[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:08,753 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,757 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,758 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:08,758 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:08,758 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:08,758 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,758 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:08,767 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,767 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:08,768 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:08,768 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:08,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:08,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:08,777 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:08,777 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:08,777 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:08,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,778 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:08,782 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,782 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:08,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,782 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:08,783 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:08,785 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:08,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:08,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:08,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:08,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:08,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:08,800 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:08,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,801 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,801 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,801 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,801 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:08,802 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:08,802 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:08,902 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:08,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:08,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,932 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:08,932 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:08,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:08,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:08,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,941 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:08,941 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:08,941 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,941 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:08,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,942 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,943 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:08,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:08,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:08,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:08,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:08,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:08,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:08,943 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:08,944 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:08,944 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:08:09,383 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128888c184c8f6541cbb884f735c556363b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128888c184c8f6541cbb884f735c556363b 2023-02-13 10:08:09,796 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/0e1765ba43304f1a92282ec9c69467e1 2023-02-13 10:08:09,805 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/0e1765ba43304f1a92282ec9c69467e1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1 2023-02-13 10:08:09,839 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:08:09,840 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 896ms, sequenceid=9, compaction requested=false 2023-02-13 10:08:09,840 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:09,840 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:09,840 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:09,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:09,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:09,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:09,874 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,874 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:09,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:09,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:09,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:09,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:09,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:09,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ad35831[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:09,880 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:09,880 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,891 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,891 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:09,891 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:09,891 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:09,891 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,891 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:09,919 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:09,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:09,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:09,927 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:09,927 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:09,927 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:09,927 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,927 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:09,941 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,942 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,943 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:09,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:09,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:09,946 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:09,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,952 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:09,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,957 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,957 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:09,957 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:09,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:09,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:09,957 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:09,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:09,958 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:09,958 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:09,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:09,959 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,059 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:10,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:10,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:10,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:10,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,080 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:10,080 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:10,080 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:10,080 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:10,081 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,081 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,091 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:10,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:10,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:10,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:10,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,093 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:10,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:10,093 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:10,093 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:10,094 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:10,094 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:10,094 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:10,094 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:10,094 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:10,094 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:10,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:08:10,500 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 10:08:10,501 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 10:08:10,502 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 10:08:10,502 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 10:08:10,527 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201470a90f701574795b6730328652cfef4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201470a90f701574795b6730328652cfef4 2023-02-13 10:08:10,944 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/fe63b76b2a4749eb92dcffa109ed7521 2023-02-13 10:08:10,955 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/fe63b76b2a4749eb92dcffa109ed7521 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521 2023-02-13 10:08:10,965 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 10:08:10,967 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 873ms, sequenceid=13, compaction requested=true 2023-02-13 10:08:10,967 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:10,967 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:10,967 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:10,967 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:10,967 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:10,967 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:10,968 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:11,007 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,007 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:11,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:11,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:11,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b20428c[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:11,011 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:11,011 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,016 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,016 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:11,016 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:11,016 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:11,016 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,017 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:11,025 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:11,025 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,025 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:11,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:11,025 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:11,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:11,034 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:11,034 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:11,034 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:11,034 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,035 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:11,041 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,041 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,041 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:11,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:11,041 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,043 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:11,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:11,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:11,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:11,049 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:11,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:11,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:11,050 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,050 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,050 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:11,051 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:11,151 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:11,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:11,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:11,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:11,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,170 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:11,170 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:11,171 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:11,171 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:11,171 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,171 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,182 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:11,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:11,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:11,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:11,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,184 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:11,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:11,184 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:11,184 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:11,185 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:11,185 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:11,185 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:11,185 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:11,185 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:11,185 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:11,625 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120534acfb0cb0fc4df499e6b186225f21ff to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120534acfb0cb0fc4df499e6b186225f21ff 2023-02-13 10:08:12,041 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/107b03e2d8cb424cb987858c8dfbd982 2023-02-13 10:08:12,055 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/107b03e2d8cb424cb987858c8dfbd982 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982 2023-02-13 10:08:12,065 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 10:08:12,067 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 882ms, sequenceid=17, compaction requested=true 2023-02-13 10:08:12,067 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:12,067 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:12,067 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:12,068 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:12,068 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,068 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:12,068 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:12,107 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,107 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:12,108 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,108 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:12,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:12,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51155d0b[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:12,111 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:12,111 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,116 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,116 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:12,116 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:12,116 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:12,116 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,116 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:12,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:12,125 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:12,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:12,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:12,132 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:12,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:12,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:12,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,132 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:12,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:12,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,141 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:12,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,143 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:12,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:12,157 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:12,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:12,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:12,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:12,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:12,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:12,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:12,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,159 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:12,159 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:12,159 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:12,259 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:12,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:12,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,274 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:12,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:12,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:12,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:12,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:12,282 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:12,283 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:12,283 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:12,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:12,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:12,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:12,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:12,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:12,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:12,285 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:12,285 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:12,286 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:12,716 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283d17ecb17ce74b65bc9411ad3520740d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283d17ecb17ce74b65bc9411ad3520740d 2023-02-13 10:08:13,129 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/e89b0875e83b47e8aa3ca4bd90a23b1f 2023-02-13 10:08:13,141 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/e89b0875e83b47e8aa3ca4bd90a23b1f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f 2023-02-13 10:08:13,151 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 10:08:13,152 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 866ms, sequenceid=21, compaction requested=true 2023-02-13 10:08:13,152 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:13,152 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:13,152 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:13,153 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:13,153 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,153 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:13,153 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:13,189 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,189 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:13,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:13,190 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,190 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:13,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:13,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:13,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:13,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:13,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@183fb3e0[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:13,194 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:13,194 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,207 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:13,208 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,208 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:13,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:13,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:13,215 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:13,216 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,216 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:13,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:13,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:13,216 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:13,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:13,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:13,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:13,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:13,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:13,219 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:13,219 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:13,219 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:13,219 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,219 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:13,224 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,224 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:13,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:13,224 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:13,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:13,225 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:13,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,226 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:13,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:13,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:13,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:13,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:13,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:13,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:13,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,232 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:13,233 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,233 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:13,234 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:13,234 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:13,234 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,234 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:13,334 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:13,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:13,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:13,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:13,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,346 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:13,346 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:13,347 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:13,347 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:13,347 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,347 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,366 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:13,366 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:13,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:13,366 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:13,366 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:13,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:13,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,367 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:13,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:13,368 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:13,368 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:13,368 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:13,368 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:13,368 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:13,368 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:13,368 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:13,369 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:13,798 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b405bf8319743459bfa1026dac5394b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316b405bf8319743459bfa1026dac5394b 2023-02-13 10:08:14,208 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/54f77351abd543be900cf3b2c3bbf7df 2023-02-13 10:08:14,226 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/54f77351abd543be900cf3b2c3bbf7df as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df 2023-02-13 10:08:14,235 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 10:08:14,236 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 867ms, sequenceid=25, compaction requested=true 2023-02-13 10:08:14,237 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:14,237 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:14,237 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:14,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:14,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:14,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:14,249 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,249 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,249 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,250 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:14,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8bd6206[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:14,251 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:14,251 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,257 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,257 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:14,257 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,258 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:14,257 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:14,258 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:14,315 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:14,315 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,315 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:14,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,315 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:14,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:14,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:14,321 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:14,321 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:14,321 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:14,322 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,322 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:14,332 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,332 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,333 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:14,334 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,337 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,348 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:14,348 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:14,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:14,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:14,349 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:14,349 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:14,349 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,349 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:14,350 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:14,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:14,450 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:14,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:14,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:14,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:14,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,462 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:14,462 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:14,462 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:14,462 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:14,463 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,463 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,473 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,473 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:14,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:14,474 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,474 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:14,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,476 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:14,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,476 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:14,476 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:14,477 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:14,477 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:14,477 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:14,477 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:14,477 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:14,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:14,902 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010bd78da1ebbd4731ab407051804e5a13 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010bd78da1ebbd4731ab407051804e5a13 2023-02-13 10:08:14,911 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/3aa6767f8a324c108bd9e93899117882 2023-02-13 10:08:14,918 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/3aa6767f8a324c108bd9e93899117882 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882 2023-02-13 10:08:14,928 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 10:08:14,929 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 452ms, sequenceid=29, compaction requested=true 2023-02-13 10:08:14,930 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:14,930 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:14,930 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:14,931 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:14,931 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,931 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:14,931 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:14,940 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:14,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e075bf[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:14,943 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:14,943 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,949 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,949 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:14,949 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:14,949 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:14,949 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,949 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:14,957 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:14,957 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,957 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:14,957 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:14,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:14,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:14,960 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:14,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:14,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:14,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,960 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:14,966 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,966 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,966 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:14,967 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,969 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,021 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,021 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:15,021 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:15,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:15,022 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,022 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:15,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:15,022 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:15,022 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:15,023 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:15,024 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,024 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:15,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:15,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:15,024 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,025 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,124 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:15,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:15,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:15,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:15,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,136 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:15,136 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:15,136 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:15,136 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:15,137 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,137 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,140 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:15,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:15,141 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,141 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:15,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,142 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:15,142 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:15,142 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:15,143 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:15,143 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:15,143 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:15,143 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:15,143 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:15,165 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010373d718c13fbc4a6b8910a5320f8ed372 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010373d718c13fbc4a6b8910a5320f8ed372 2023-02-13 10:08:15,577 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/ac658555ecf844c2ad55bc03c868c42b 2023-02-13 10:08:15,591 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/ac658555ecf844c2ad55bc03c868c42b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b 2023-02-13 10:08:15,598 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 10:08:15,600 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 457ms, sequenceid=33, compaction requested=true 2023-02-13 10:08:15,600 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:15,600 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:15,600 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:15,600 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:15,600 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,601 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:15,601 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:15,607 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:15,608 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,608 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:15,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:15,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:15,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:15,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae6818d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:15,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:15,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,615 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:15,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:15,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:15,616 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,616 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:15,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:15,624 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:15,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:15,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:15,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:15,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:15,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:15,629 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:15,629 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:15,629 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:15,629 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,629 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:15,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:15,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:15,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:15,642 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,643 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:15,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:15,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:15,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:15,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:15,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:15,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:15,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:15,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:15,650 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:15,750 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:15,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:15,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:15,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:15,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,769 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:15,769 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:15,770 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:15,770 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:15,770 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,770 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,774 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:15,774 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:15,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:15,774 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:15,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:15,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:15,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:15,777 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:15,777 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:15,778 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:15,778 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:15,778 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:15,778 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:15,778 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:15,778 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:16,209 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d4b14a06584c4d1f9e9c5296dbd9e425 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907d4b14a06584c4d1f9e9c5296dbd9e425 2023-02-13 10:08:16,621 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/a19098b8705d4ebcb655316eeec874ae 2023-02-13 10:08:16,632 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/a19098b8705d4ebcb655316eeec874ae as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae 2023-02-13 10:08:16,641 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 10:08:16,642 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 864ms, sequenceid=37, compaction requested=true 2023-02-13 10:08:16,642 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:16,642 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:16,642 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:16,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:16,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:16,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:16,682 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,682 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:16,683 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,683 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:16,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:16,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f238182[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:16,687 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:16,687 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,691 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,691 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:16,691 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:16,691 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:16,691 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,691 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:16,699 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:16,699 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:16,699 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,699 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:16,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:16,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:16,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:16,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:16,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:16,706 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:16,706 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:16,706 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:16,706 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,706 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:16,715 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,715 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:16,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,716 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:16,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:16,716 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,717 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:16,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:16,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:16,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,724 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,724 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:16,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:16,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:16,725 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,725 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,725 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:16,725 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:16,725 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,825 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:16,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:16,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:16,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,844 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:16,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:16,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 10:08:16,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 10:08:16,845 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,845 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,849 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,849 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:16,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:16,849 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:16,849 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 10:08:16,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:16,850 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 10:08:16,850 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:16,851 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 10:08:16,851 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:16,851 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:16,851 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:16,852 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. started... 2023-02-13 10:08:16,852 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f92606d2b350e4ac8e2f20872f822e8b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:17,281 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112062a93bad276041f08423026db560078f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a93bad276041f08423026db560078f 2023-02-13 10:08:17,692 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/f3367cd520514450b3e71ed46f390249 2023-02-13 10:08:17,701 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/f3367cd520514450b3e71ed46f390249 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249 2023-02-13 10:08:17,708 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 10:08:17,709 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f92606d2b350e4ac8e2f20872f822e8b in 857ms, sequenceid=41, compaction requested=true 2023-02-13 10:08:17,709 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:17,709 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:17,709 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:17,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:17,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 10:08:17,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 10:08:17,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:17,749 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,749 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:17,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:17,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 10:08:17,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6d6132[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:17,755 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 10:08:17,755 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,784 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 10:08:17,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 10:08:17,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:17,785 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,786 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:17,799 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 10:08:17,799 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:17,799 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 10:08:17,799 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:17,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:17,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:17,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:17,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 10:08:17,803 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 10:08:17,803 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:17,804 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:17,804 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,804 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:17,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:17,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:17,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:17,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:17,808 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,809 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:17,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:17,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:17,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 10:08:17,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 10:08:17,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:17,816 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:17,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:17,816 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:17,917 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:17,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:17,924 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 10:08:17,927 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 10:08:17,929 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:17,943 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:17,944 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:17,946 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:17,946 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283497946 2023-02-13 10:08:17,949 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:08:17,953 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 10:08:17,953 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:17,953 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x30ffdef6 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:17,966 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54289d29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:17,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:18,882 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103724677d7bd4442e394ce8912d60c0b14 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103724677d7bd4442e394ce8912d60c0b14 2023-02-13 10:08:18,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:18,903 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:18,904 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34126, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:18,915 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:18,917 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:18,952 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b5b48464b524b45bfaf053d1dd3b5be first=Optional[r3] last=Optional[r6] 2023-02-13 10:08:18,966 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b5b48464b524b45bfaf053d1dd3b5be}] 2023-02-13 10:08:18,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b5b48464b524b45bfaf053d1dd3b5be for inclusion in f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:18,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 10:08:18,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:18,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:18,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b5b48464b524b45bfaf053d1dd3b5be to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7la4hpegur4fj07ppsmpginvb24runft78uf5aanmnm8pqua8aedgbj9ogulgkdu/family1/9b5b48464b524b45bfaf053d1dd3b5be 2023-02-13 10:08:18,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7la4hpegur4fj07ppsmpginvb24runft78uf5aanmnm8pqua8aedgbj9ogulgkdu/family1/9b5b48464b524b45bfaf053d1dd3b5be as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_ 2023-02-13 10:08:18,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7la4hpegur4fj07ppsmpginvb24runft78uf5aanmnm8pqua8aedgbj9ogulgkdu/family1/9b5b48464b524b45bfaf053d1dd3b5be into f92606d2b350e4ac8e2f20872f822e8b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_ - updating store file list. 2023-02-13 10:08:19,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_ into f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:19,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7la4hpegur4fj07ppsmpginvb24runft78uf5aanmnm8pqua8aedgbj9ogulgkdu/family1/9b5b48464b524b45bfaf053d1dd3b5be into f92606d2b350e4ac8e2f20872f822e8b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_) 2023-02-13 10:08:19,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7la4hpegur4fj07ppsmpginvb24runft78uf5aanmnm8pqua8aedgbj9ogulgkdu/family1/9b5b48464b524b45bfaf053d1dd3b5be 2023-02-13 10:08:19,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:08:19,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:08:19,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): f92606d2b350e4ac8e2f20872f822e8b/family1 is initiating minor compaction 2023-02-13 10:08:19,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58d55a11; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:19,014 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f92606d2b350e4ac8e2f20872f822e8b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:19,015 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp, totalSize=50.2 K 2023-02-13 10:08:19,015 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 0e1765ba43304f1a92282ec9c69467e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:08:19,015 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting fe63b76b2a4749eb92dcffa109ed7521, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:08:19,015 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 107b03e2d8cb424cb987858c8dfbd982, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:08:19,015 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting e89b0875e83b47e8aa3ca4bd90a23b1f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:08:19,015 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 54f77351abd543be900cf3b2c3bbf7df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:08:19,016 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 3aa6767f8a324c108bd9e93899117882, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:08:19,016 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting ac658555ecf844c2ad55bc03c868c42b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:08:19,016 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting a19098b8705d4ebcb655316eeec874ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:08:19,016 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting f3367cd520514450b3e71ed46f390249, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:08:19,016 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:08:19,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:19,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:19,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283d17ecb17ce74b65bc9411ad3520740d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283d17ecb17ce74b65bc9411ad3520740d 2023-02-13 10:08:19,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316b405bf8319743459bfa1026dac5394b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316b405bf8319743459bfa1026dac5394b 2023-02-13 10:08:19,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010bd78da1ebbd4731ab407051804e5a13 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010bd78da1ebbd4731ab407051804e5a13 2023-02-13 10:08:19,043 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010373d718c13fbc4a6b8910a5320f8ed372 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010373d718c13fbc4a6b8910a5320f8ed372 2023-02-13 10:08:19,043 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-13 10:08:19,043 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,066 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): f92606d2b350e4ac8e2f20872f822e8b#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:19,542 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ebf80abeb0384c57ae4dfc58e8546dc1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ebf80abeb0384c57ae4dfc58e8546dc1 2023-02-13 10:08:19,544 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:19,573 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfb0a88c14f449f3b417c7b805c73323 first=Optional[r00] last=Optional[r2] 2023-02-13 10:08:19,574 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfb0a88c14f449f3b417c7b805c73323}] 2023-02-13 10:08:19,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfb0a88c14f449f3b417c7b805c73323 for inclusion in f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:19,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 10:08:19,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:19,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:19,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfb0a88c14f449f3b417c7b805c73323 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__clh0aqbtceftn37u0nr14e8teo0knb2gbksqn3u9htcrb3hkbmi7c3r5u3kr3igl/family1/cfb0a88c14f449f3b417c7b805c73323 2023-02-13 10:08:19,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__clh0aqbtceftn37u0nr14e8teo0knb2gbksqn3u9htcrb3hkbmi7c3r5u3kr3igl/family1/cfb0a88c14f449f3b417c7b805c73323 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ 2023-02-13 10:08:19,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__clh0aqbtceftn37u0nr14e8teo0knb2gbksqn3u9htcrb3hkbmi7c3r5u3kr3igl/family1/cfb0a88c14f449f3b417c7b805c73323 into f92606d2b350e4ac8e2f20872f822e8b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ - updating store file list. 2023-02-13 10:08:19,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ into f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:19,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__clh0aqbtceftn37u0nr14e8teo0knb2gbksqn3u9htcrb3hkbmi7c3r5u3kr3igl/family1/cfb0a88c14f449f3b417c7b805c73323 into f92606d2b350e4ac8e2f20872f822e8b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_) 2023-02-13 10:08:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__clh0aqbtceftn37u0nr14e8teo0knb2gbksqn3u9htcrb3hkbmi7c3r5u3kr3igl/family1/cfb0a88c14f449f3b417c7b805c73323 2023-02-13 10:08:19,594 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:19,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:19,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c1887c0d74064014b308209fc3181ddd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c1887c0d74064014b308209fc3181ddd 2023-02-13 10:08:19,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201470a90f701574795b6730328652cfef4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201470a90f701574795b6730328652cfef4 2023-02-13 10:08:19,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120534acfb0cb0fc4df499e6b186225f21ff to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120534acfb0cb0fc4df499e6b186225f21ff 2023-02-13 10:08:19,600 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-13 10:08:19,600 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 10:08:19,601 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:19,601 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:19,601 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:19,602 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:19,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6670 sec 2023-02-13 10:08:19,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 10:08:19,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:19,896 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/5bc37fd711384022a678a9678774cbc2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2 2023-02-13 10:08:19,913 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f92606d2b350e4ac8e2f20872f822e8b/family1 of f92606d2b350e4ac8e2f20872f822e8b into 5bc37fd711384022a678a9678774cbc2(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:08:19,913 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:19,915 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676282899012; duration=0sec 2023-02-13 10:08:19,916 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:20,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_] to archive 2023-02-13 10:08:20,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:20,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/0e1765ba43304f1a92282ec9c69467e1 2023-02-13 10:08:20,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/fe63b76b2a4749eb92dcffa109ed7521 2023-02-13 10:08:20,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/107b03e2d8cb424cb987858c8dfbd982 2023-02-13 10:08:20,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/e89b0875e83b47e8aa3ca4bd90a23b1f 2023-02-13 10:08:20,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/54f77351abd543be900cf3b2c3bbf7df 2023-02-13 10:08:20,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/3aa6767f8a324c108bd9e93899117882 2023-02-13 10:08:20,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/ac658555ecf844c2ad55bc03c868c42b 2023-02-13 10:08:20,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a19098b8705d4ebcb655316eeec874ae 2023-02-13 10:08:20,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/f3367cd520514450b3e71ed46f390249 2023-02-13 10:08:20,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/6e8a6fa6f7084a6a8ba026f051d9d738_SeqId_44_ 2023-02-13 10:08:20,190 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 10:08:20,194 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:20,194 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 10:08:20,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-13 10:08:20,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, REOPEN/MOVE}] 2023-02-13 10:08:20,213 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, REOPEN/MOVE 2023-02-13 10:08:20,214 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:20,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282900214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282900214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282900214"}]},"ts":"1676282900214"} 2023-02-13 10:08:20,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:20,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing f92606d2b350e4ac8e2f20872f822e8b, disabling compactions & flushes 2023-02-13 10:08:20,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. after waiting 0 ms 2023-02-13 10:08:20,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-13 10:08:20,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for f92606d2b350e4ac8e2f20872f822e8b: Waiting for close lock at 1676282900379Running coprocessor pre-close hooks at 1676282900379Disabling compacts and flushes for region at 1676282900379Disabling writes for close at 1676282900379Writing region close event to WAL at 1676282900387 (+8 ms)Running coprocessor post-close hooks at 1676282900397 (+10 ms)Closed at 1676282900398 (+1 ms) 2023-02-13 10:08:20,398 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: f92606d2b350e4ac8e2f20872f822e8b to self. 2023-02-13 10:08:20,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,403 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=CLOSED 2023-02-13 10:08:20,403 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282900402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282900402"}]},"ts":"1676282900402"} 2023-02-13 10:08:20,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 10:08:20,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 188 msec 2023-02-13 10:08:20,410 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=true 2023-02-13 10:08:20,561 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:20,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282900561"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282900561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282900561"}]},"ts":"1676282900561"} 2023-02-13 10:08:20,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:20,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f92606d2b350e4ac8e2f20872f822e8b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:20,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:20,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,734 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,736 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:20,736 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:20,737 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f92606d2b350e4ac8e2f20872f822e8b columnFamilyName family1 2023-02-13 10:08:20,751 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484 2023-02-13 10:08:20,758 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2 2023-02-13 10:08:20,763 DEBUG [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ 2023-02-13 10:08:20,764 INFO [StoreOpener-f92606d2b350e4ac8e2f20872f822e8b-1] regionserver.HStore(310): Store=f92606d2b350e4ac8e2f20872f822e8b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:20,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:08:20,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened f92606d2b350e4ac8e2f20872f822e8b; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75332871, jitterRate=0.12254725396633148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:20,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for f92606d2b350e4ac8e2f20872f822e8b: Running coprocessor pre-open hook at 1676282900731Writing region info on filesystem at 1676282900731Initializing all the Stores at 1676282900733 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676282900733Cleaning up temporary data from old regions at 1676282900767 (+34 ms)Cleaning up detritus from prior splits at 1676282900767Running coprocessor post-open hooks at 1676282900770 (+3 ms)Region opened successfully at 1676282900770 2023-02-13 10:08:20,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., pid=17, masterSystemTime=1676282900722 2023-02-13 10:08:20,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:20,772 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:08:20,774 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:08:20,774 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1912): f92606d2b350e4ac8e2f20872f822e8b/family1 is initiating minor compaction (all files) 2023-02-13 10:08:20,774 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f92606d2b350e4ac8e2f20872f822e8b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,774 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp, totalSize=358.6 K 2023-02-13 10:08:20,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:08:20,775 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 2347dd782d96472b95993509bb49d484, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:08:20,775 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f92606d2b350e4ac8e2f20872f822e8b, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:20,775 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 5bc37fd711384022a678a9678774cbc2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:08:20,775 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676282900775"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282900775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282900775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282900775"}]},"ts":"1676282900775"} 2023-02-13 10:08:20,775 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting a97f014be1b942909699a40fea52e3b1_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878806172 2023-02-13 10:08:20,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-13 10:08:20,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure f92606d2b350e4ac8e2f20872f822e8b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 211 msec 2023-02-13 10:08:20,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-13 10:08:20,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f92606d2b350e4ac8e2f20872f822e8b, REOPEN/MOVE in 567 msec 2023-02-13 10:08:20,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-13 10:08:20,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 584 msec 2023-02-13 10:08:20,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0200 sec 2023-02-13 10:08:20,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-13 10:08:20,799 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(278): alter status finished 2023-02-13 10:08:20,801 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 10:08:20,803 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:20,803 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:20,805 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283500805 2023-02-13 10:08:20,805 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:20,806 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:08:20,807 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 10:08:20,807 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:20,808 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x30a1f021 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:20,814 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): f92606d2b350e4ac8e2f20872f822e8b#family1#compaction#11 average throughput is 5.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:20,900 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28fcb9b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:20,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:20,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:20,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:20,901 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:20,901 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:21,660 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/.tmp/family1/621c47a7dcff4f9f93b460df15a1810f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/621c47a7dcff4f9f93b460df15a1810f 2023-02-13 10:08:21,669 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f92606d2b350e4ac8e2f20872f822e8b/family1 of f92606d2b350e4ac8e2f20872f822e8b into 621c47a7dcff4f9f93b460df15a1810f(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:08:21,669 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:21,669 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., storeName=f92606d2b350e4ac8e2f20872f822e8b/family1, priority=13, startTime=1676282900771; duration=0sec 2023-02-13 10:08:21,669 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:21,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_] to archive 2023-02-13 10:08:21,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:21,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/2347dd782d96472b95993509bb49d484 2023-02-13 10:08:21,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/5bc37fd711384022a678a9678774cbc2 2023-02-13 10:08:21,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a97f014be1b942909699a40fea52e3b1_SeqId_46_ 2023-02-13 10:08:21,741 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f6d931f2342f408792092aea8e80fced to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f6d931f2342f408792092aea8e80fced 2023-02-13 10:08:21,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:21,757 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:21,758 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:21,767 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:21,769 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:21,783 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05cbfe35130d41859865c681fa388826 first=Optional[r05] last=Optional[r8] 2023-02-13 10:08:21,784 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=50 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05cbfe35130d41859865c681fa388826}] 2023-02-13 10:08:21,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05cbfe35130d41859865c681fa388826 for inclusion in f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:21,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 10:08:21,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:21,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f92606d2b350e4ac8e2f20872f822e8b: 2023-02-13 10:08:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05cbfe35130d41859865c681fa388826 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m74s3jmv29cggu0ma51dm42aomb1apcg5jnt9tg0uomtr7l67fpvammpv75r88gc/family1/05cbfe35130d41859865c681fa388826 2023-02-13 10:08:21,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m74s3jmv29cggu0ma51dm42aomb1apcg5jnt9tg0uomtr7l67fpvammpv75r88gc/family1/05cbfe35130d41859865c681fa388826 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a266c67d4c2e4c05b961a7eb6b2f10f7_SeqId_53_ 2023-02-13 10:08:21,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m74s3jmv29cggu0ma51dm42aomb1apcg5jnt9tg0uomtr7l67fpvammpv75r88gc/family1/05cbfe35130d41859865c681fa388826 into f92606d2b350e4ac8e2f20872f822e8b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a266c67d4c2e4c05b961a7eb6b2f10f7_SeqId_53_ - updating store file list. 2023-02-13 10:08:21,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a266c67d4c2e4c05b961a7eb6b2f10f7_SeqId_53_ into f92606d2b350e4ac8e2f20872f822e8b/family1 2023-02-13 10:08:21,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m74s3jmv29cggu0ma51dm42aomb1apcg5jnt9tg0uomtr7l67fpvammpv75r88gc/family1/05cbfe35130d41859865c681fa388826 into f92606d2b350e4ac8e2f20872f822e8b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/family1/a266c67d4c2e4c05b961a7eb6b2f10f7_SeqId_53_) 2023-02-13 10:08:21,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m74s3jmv29cggu0ma51dm42aomb1apcg5jnt9tg0uomtr7l67fpvammpv75r88gc/family1/05cbfe35130d41859865c681fa388826 2023-02-13 10:08:21,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:21,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:21,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a93bad276041f08423026db560078f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a93bad276041f08423026db560078f 2023-02-13 10:08:21,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128888c184c8f6541cbb884f735c556363b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128888c184c8f6541cbb884f735c556363b 2023-02-13 10:08:21,814 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-13 10:08:21,814 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 10:08:21,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:21,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:21,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 10:08:21,814 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 10:08:21,815 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:21,815 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 10:08:21,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.0130 sec 2023-02-13 10:08:21,923 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=247 (was 211) Potentially hanging thread: hconnection-0x499167c0-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1717170749_15 at /127.0.0.1:38844 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33072 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30ffdef6-SendThread(127.0.0.1:57475) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33120 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33130 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30ffdef6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1462197654.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33122 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30a1f021 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1462197654.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2da201-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33084 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33158 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33090 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33040 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30a1f021-SendThread(127.0.0.1:57475) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase16:38311-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x499167c0-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30a1f021-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: (jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x499167c0-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x30ffdef6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x499167c0-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33060 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2da201-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33094 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:33150 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2da201-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:38834 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=584 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 306), ProcessCount=168 (was 168), AvailableMemoryMB=6582 (was 6726) 2023-02-13 10:08:21,935 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=584, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=6581 2023-02-13 10:08:21,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 10:08:21,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:21,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:21,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-13 10:08:21,942 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:21,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:21,943 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:21,944 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c empty. 2023-02-13 10:08:21,944 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:21,945 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-13 10:08:22,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:22,359 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:22,362 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1cad52cf8b278bc4b5803d83efcec02c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:22,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:22,770 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:22,770 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 1cad52cf8b278bc4b5803d83efcec02c, disabling compactions & flushes 2023-02-13 10:08:22,770 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:22,770 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:22,770 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. after waiting 0 ms 2023-02-13 10:08:22,770 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:22,771 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:22,771 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 1cad52cf8b278bc4b5803d83efcec02c: Waiting for close lock at 1676282902770Disabling compacts and flushes for region at 1676282902770Disabling writes for close at 1676282902770Writing region close event to WAL at 1676282902771 (+1 ms)Closed at 1676282902771 2023-02-13 10:08:22,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:22,776 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676282902775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282902775"}]},"ts":"1676282902775"} 2023-02-13 10:08:22,778 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:08:22,779 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:22,779 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282902779"}]},"ts":"1676282902779"} 2023-02-13 10:08:22,781 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 10:08:22,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1cad52cf8b278bc4b5803d83efcec02c, ASSIGN}] 2023-02-13 10:08:22,862 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1cad52cf8b278bc4b5803d83efcec02c, ASSIGN 2023-02-13 10:08:22,865 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1cad52cf8b278bc4b5803d83efcec02c, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:23,016 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1cad52cf8b278bc4b5803d83efcec02c, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:23,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676282903016"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282903016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282903016"}]},"ts":"1676282903016"} 2023-02-13 10:08:23,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 1cad52cf8b278bc4b5803d83efcec02c, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:23,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:23,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:23,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1cad52cf8b278bc4b5803d83efcec02c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:23,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:23,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,184 INFO [StoreOpener-1cad52cf8b278bc4b5803d83efcec02c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,186 DEBUG [StoreOpener-1cad52cf8b278bc4b5803d83efcec02c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:23,186 DEBUG [StoreOpener-1cad52cf8b278bc4b5803d83efcec02c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:23,186 INFO [StoreOpener-1cad52cf8b278bc4b5803d83efcec02c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cad52cf8b278bc4b5803d83efcec02c columnFamilyName family1 2023-02-13 10:08:23,188 INFO [StoreOpener-1cad52cf8b278bc4b5803d83efcec02c-1] regionserver.HStore(310): Store=1cad52cf8b278bc4b5803d83efcec02c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:23,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:08:23,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:23,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1cad52cf8b278bc4b5803d83efcec02c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71058771, jitterRate=0.058858200907707214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:23,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1cad52cf8b278bc4b5803d83efcec02c: Running coprocessor pre-open hook at 1676282903182Writing region info on filesystem at 1676282903182Initializing all the Stores at 1676282903183 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676282903183Cleaning up temporary data from old regions at 1676282903190 (+7 ms)Cleaning up detritus from prior splits at 1676282903190Running coprocessor post-open hooks at 1676282903195 (+5 ms)Region opened successfully at 1676282903195 2023-02-13 10:08:23,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., pid=21, masterSystemTime=1676282903171 2023-02-13 10:08:23,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:23,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:23,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1cad52cf8b278bc4b5803d83efcec02c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:23,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676282903198"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282903198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282903198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282903198"}]},"ts":"1676282903198"} 2023-02-13 10:08:23,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 10:08:23,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 1cad52cf8b278bc4b5803d83efcec02c, server=jenkins-hbase16.apache.org,38311,1676282881622 in 182 msec 2023-02-13 10:08:23,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-13 10:08:23,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1cad52cf8b278bc4b5803d83efcec02c, ASSIGN in 345 msec 2023-02-13 10:08:23,204 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:23,205 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282903204"}]},"ts":"1676282903204"} 2023-02-13 10:08:23,206 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 10:08:23,216 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:23,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2780 sec 2023-02-13 10:08:24,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 10:08:24,053 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-13 10:08:24,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:24,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,091 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:24,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:24,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:24,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:24,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,123 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:24,123 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:24,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:24,124 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:24,124 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:24,126 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:24,126 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:24,126 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:24,126 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:24,126 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:24,126 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:24,126 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:24,127 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:08:24,560 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113047042fb6df16459ca83e5a57518db9a8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113047042fb6df16459ca83e5a57518db9a8 2023-02-13 10:08:24,967 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/6447258d9df2465ebb85e6c44091cad9 2023-02-13 10:08:24,980 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/6447258d9df2465ebb85e6c44091cad9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9 2023-02-13 10:08:24,986 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 10:08:24,987 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 860ms, sequenceid=5, compaction requested=false 2023-02-13 10:08:24,987 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:24,988 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:24,988 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:24,988 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:24,988 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:24,988 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:24,988 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:24,988 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:25,015 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,015 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:25,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:25,016 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,016 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:25,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:25,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:25,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:25,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:25,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e42a28d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:25,018 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:25,018 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,023 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:25,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:25,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:25,024 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,024 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:25,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:25,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:25,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:25,032 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:25,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:25,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:25,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:25,038 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:25,038 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:25,038 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:25,038 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,038 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:25,048 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,048 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,049 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:25,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:25,049 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,050 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,057 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,057 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:25,057 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:25,057 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,057 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:25,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:25,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:25,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:25,057 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:25,058 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:25,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:25,158 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:25,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:25,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,175 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:25,175 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:25,176 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:25,176 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:25,177 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,177 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,182 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:25,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:25,183 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:25,183 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:25,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:25,185 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:25,185 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:25,186 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:25,186 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:25,186 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:25,186 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:25,186 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:25,187 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:08:25,614 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288a737a968eba4f198880c54be881d1eb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288a737a968eba4f198880c54be881d1eb 2023-02-13 10:08:25,937 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:08:26,021 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/e3488f005bcc4d0ab0c38be0a3cc99c2 2023-02-13 10:08:26,030 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/e3488f005bcc4d0ab0c38be0a3cc99c2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2 2023-02-13 10:08:26,040 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:08:26,042 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 855ms, sequenceid=9, compaction requested=false 2023-02-13 10:08:26,042 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:26,042 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:26,042 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:26,042 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:26,042 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,043 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:26,043 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:26,082 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:26,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:26,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5006ae21[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:26,084 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:26,084 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,090 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,090 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:26,090 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:26,090 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:26,090 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,090 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:26,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:26,098 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:26,099 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:26,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:26,101 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:26,102 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:26,102 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:26,102 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,102 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:26,107 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,107 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,107 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:26,107 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:26,108 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:26,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,136 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:26,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:26,136 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,137 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:26,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:26,138 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:26,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:26,137 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,138 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:26,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:26,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:26,139 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,239 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:26,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:26,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:26,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:26,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,258 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:26,258 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:26,259 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:26,259 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:26,260 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,260 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,274 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:26,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:26,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,275 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:26,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:26,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:26,278 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:26,279 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:26,279 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:26,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:26,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:26,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:26,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:26,280 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:26,702 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ac725f4e52d34abe943c95c275652719 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac725f4e52d34abe943c95c275652719 2023-02-13 10:08:27,109 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/7d67ec39987843039ee7d0866b36c1c8 2023-02-13 10:08:27,117 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/7d67ec39987843039ee7d0866b36c1c8 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8 2023-02-13 10:08:27,124 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 10:08:27,125 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 845ms, sequenceid=13, compaction requested=true 2023-02-13 10:08:27,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:27,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:27,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:27,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:27,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:27,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:27,132 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,132 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,132 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,132 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:27,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33ca0a32[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:27,133 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:27,133 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,140 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,140 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:27,140 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:27,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:27,140 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:27,157 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:27,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,157 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:27,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,157 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:27,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:27,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:27,160 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:27,160 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:27,160 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:27,160 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,160 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:27,173 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,173 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,174 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:27,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,174 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,177 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,190 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,190 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,190 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:27,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:27,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:27,190 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:27,190 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:27,190 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:27,191 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:27,191 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,191 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:27,192 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:27,192 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:27,192 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,292 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:27,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:27,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:27,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,304 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:27,304 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:27,305 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:27,305 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:27,306 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,306 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,315 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:27,315 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:27,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:27,316 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,316 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:27,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:27,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,317 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:27,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,317 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:27,317 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:27,317 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:27,318 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:27,318 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:27,318 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:27,318 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:27,318 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:27,739 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120575b035c2cd59476e915064c2be73ff4b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120575b035c2cd59476e915064c2be73ff4b 2023-02-13 10:08:27,747 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/821e95d090d642eda508b0ff0a6cddd8 2023-02-13 10:08:27,754 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/821e95d090d642eda508b0ff0a6cddd8 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8 2023-02-13 10:08:27,761 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 10:08:27,762 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 444ms, sequenceid=17, compaction requested=true 2023-02-13 10:08:27,762 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:27,762 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:27,762 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:27,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:27,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:27,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:27,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,773 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,774 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,774 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:27,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44d99988[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:27,776 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:27,776 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,782 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:27,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:27,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:27,782 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,782 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:27,790 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:27,790 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:27,790 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,790 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:27,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:27,797 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:27,797 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:27,797 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:27,797 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,797 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:27,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,807 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:27,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:27,808 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,811 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,823 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,824 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,824 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:27,824 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:27,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:27,824 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:27,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:27,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:27,824 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,824 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:27,825 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,826 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:27,826 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:27,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:27,826 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,826 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:27,926 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:27,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:27,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:27,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:27,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,941 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:27,941 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:27,942 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:27,942 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:27,943 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,943 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,949 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:27,949 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:27,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:27,950 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:27,950 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:27,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:27,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,952 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,952 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:27,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:27,953 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:27,953 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:27,953 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:27,954 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:27,954 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:27,954 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:27,954 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:27,954 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:28,383 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f9d171da5f3b45d49fc03b8f40d41ca3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9d171da5f3b45d49fc03b8f40d41ca3 2023-02-13 10:08:28,794 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/9e48344535f44bd9b7e3e5e02c7f9a2f 2023-02-13 10:08:28,804 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/9e48344535f44bd9b7e3e5e02c7f9a2f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f 2023-02-13 10:08:28,811 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 10:08:28,812 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 858ms, sequenceid=21, compaction requested=true 2023-02-13 10:08:28,812 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:28,812 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:28,812 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:28,812 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:28,812 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:28,812 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:28,812 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:29,062 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:29,064 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,064 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:29,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:29,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:29,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:29,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:29,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fe40d54[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:29,069 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:29,070 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,090 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,091 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:29,091 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:29,091 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:29,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,092 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:29,099 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:29,099 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,099 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:29,099 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:29,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:29,107 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:29,107 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:29,107 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:29,107 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,107 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:29,138 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,138 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:29,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:29,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,139 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:29,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:29,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,143 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:29,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:29,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:29,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:29,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:29,157 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:29,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:29,158 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,158 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:29,159 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:29,159 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,159 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:29,259 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:29,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:29,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:29,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:29,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,269 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:29,269 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:29,270 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:29,270 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:29,270 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,270 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,273 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:29,273 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:29,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:29,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:29,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,276 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,276 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:29,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:29,276 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:29,276 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:29,277 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:29,277 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:29,277 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:29,277 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:29,277 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:29,277 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:29,702 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231dbfde755c03a4184aa885402915ac7c7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbfde755c03a4184aa885402915ac7c7 2023-02-13 10:08:30,110 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/ec5b4ab91c114a818d48824cf4a055ed 2023-02-13 10:08:30,117 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/ec5b4ab91c114a818d48824cf4a055ed as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed 2023-02-13 10:08:30,122 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 10:08:30,124 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 847ms, sequenceid=25, compaction requested=true 2023-02-13 10:08:30,124 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:30,124 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:30,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:30,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:30,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:30,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:30,157 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,157 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:30,158 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,158 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:30,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:30,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a76d92f[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:30,162 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:30,162 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,173 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:30,174 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:30,174 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:30,174 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,174 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:30,182 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:30,182 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,182 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:30,182 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:30,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:30,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:30,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:30,187 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:30,187 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:30,187 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:30,187 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,187 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:30,199 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,199 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,199 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:30,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,200 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:30,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:30,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,203 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:30,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,215 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:30,215 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:30,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:30,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:30,215 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:30,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:30,215 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:30,216 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:30,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:30,215 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,216 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:30,216 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,217 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,217 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,217 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,217 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,317 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:30,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:30,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:30,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:30,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,327 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:30,327 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:30,327 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:30,327 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:30,328 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,328 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,332 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,332 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:30,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:30,332 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:30,332 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:30,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:30,333 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:30,333 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:30,334 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:30,334 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:30,334 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:30,334 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:30,334 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:30,334 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:30,756 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101abd50c9ba35947aebc03c7785c7f318f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd50c9ba35947aebc03c7785c7f318f 2023-02-13 10:08:31,165 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4 2023-02-13 10:08:31,178 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4 2023-02-13 10:08:31,185 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 10:08:31,186 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 852ms, sequenceid=29, compaction requested=true 2023-02-13 10:08:31,187 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:31,187 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:31,187 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:31,187 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:31,187 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,187 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:31,187 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:31,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,231 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:31,232 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:31,232 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:31,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:31,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@298ec1c9[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:31,237 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:31,237 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,248 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,249 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:31,249 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:31,249 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:31,249 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,249 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:31,257 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:31,257 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:31,257 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:31,257 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:31,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:31,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:31,269 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:31,269 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:31,269 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:31,269 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,270 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:31,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:31,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:31,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:31,284 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,287 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,298 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:31,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:31,298 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:31,299 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,301 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:31,299 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:31,300 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:31,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:31,401 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:31,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:31,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,418 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:31,418 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:31,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:31,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:31,420 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,420 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,423 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,423 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:31,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:31,424 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:31,424 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:31,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:31,425 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:31,425 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:31,426 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:31,426 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:31,426 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:31,426 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:31,426 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:31,426 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:31,844 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033a1b452330b842ae9fdeb20b6f4116e3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033a1b452330b842ae9fdeb20b6f4116e3 2023-02-13 10:08:32,253 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/3dee1c677f494eadade9ae24e343bbcb 2023-02-13 10:08:32,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/3dee1c677f494eadade9ae24e343bbcb as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb 2023-02-13 10:08:32,270 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 10:08:32,271 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 845ms, sequenceid=33, compaction requested=true 2023-02-13 10:08:32,271 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:32,271 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:32,271 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:32,271 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:32,271 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,271 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:32,271 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:32,306 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,306 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:32,307 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:32,307 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:32,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:32,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:32,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:32,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@211318a9[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:32,311 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:32,311 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,339 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:32,340 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,340 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:32,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:32,341 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:32,357 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:32,357 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,357 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:32,357 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:32,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:32,367 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:32,367 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:32,367 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:32,367 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,368 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:32,373 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,373 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:32,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,373 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:32,374 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,375 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:32,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:32,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:32,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:32,382 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,382 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,383 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:32,383 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:32,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:32,483 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:32,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:32,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,501 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:32,501 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:32,501 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:32,501 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:32,502 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,502 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,507 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,507 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:32,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:32,507 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:32,508 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,510 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:32,510 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:32,510 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:32,511 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:32,511 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:32,511 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:32,930 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078ddd670d0c084c24b1931428e6f0e6f2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509078ddd670d0c084c24b1931428e6f0e6f2 2023-02-13 10:08:33,340 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/d65f06a376fa49349c47868c04052817 2023-02-13 10:08:33,353 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/d65f06a376fa49349c47868c04052817 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817 2023-02-13 10:08:33,362 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 10:08:33,363 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 852ms, sequenceid=37, compaction requested=true 2023-02-13 10:08:33,363 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:33,363 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:33,363 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:33,364 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:33,364 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,364 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:33,364 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:33,398 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,398 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:33,399 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,399 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:33,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:33,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e923f72[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:33,404 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:33,404 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,415 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,416 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:33,416 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:33,416 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:33,416 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,416 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:33,423 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:33,424 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:33,424 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:33,424 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:33,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:33,430 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:33,430 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:33,430 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:33,430 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,430 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:33,440 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,440 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:33,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,440 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:33,441 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,442 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:33,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:33,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:33,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:33,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:33,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:33,448 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:33,449 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:33,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,449 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:33,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:33,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:33,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,450 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,450 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,550 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:33,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:33,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,557 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:33,557 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:33,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:08:33,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:33,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,565 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:33,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:33,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:33,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:08:33,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:33,567 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:08:33,567 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:33,568 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:08:33,568 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:33,569 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:33,569 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:33,569 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. started... 2023-02-13 10:08:33,569 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1cad52cf8b278bc4b5803d83efcec02c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:33,988 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120533f4af966644a16bc247a027f0e6b55 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120533f4af966644a16bc247a027f0e6b55 2023-02-13 10:08:34,399 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/46ed55532f7c4104be80175528e03baa 2023-02-13 10:08:34,413 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/46ed55532f7c4104be80175528e03baa as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa 2023-02-13 10:08:34,419 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 10:08:34,420 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1cad52cf8b278bc4b5803d83efcec02c in 851ms, sequenceid=41, compaction requested=true 2023-02-13 10:08:34,420 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:34,420 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:34,420 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:34,420 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:34,420 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,420 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:08:34,420 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:08:34,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:34,449 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,449 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:34,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:34,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:08:34,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5251242e[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:34,451 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:34,451 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,457 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,457 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:34,457 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:08:34,457 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:34,457 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,457 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:34,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:08:34,465 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:34,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:34,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:08:34,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:34,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:34,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:34,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:34,471 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:08:34,471 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:34,471 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:34,471 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,472 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:34,481 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,481 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:34,481 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:34,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:34,482 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,483 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:34,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:34,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:34,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:08:34,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:34,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:34,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 10:08:34,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:34,490 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:34,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,491 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:34,492 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,492 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,492 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:34,492 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:34,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:34,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:34,492 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,592 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:34,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:34,598 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-13 10:08:34,603 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:34,604 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:34,605 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283514605 2023-02-13 10:08:34,605 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:34,606 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:08:34,608 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 10:08:34,608 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:34,609 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x23996b07 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:34,616 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ee54fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:34,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:35,453 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034a238525914e419d92fe6eeea0eaff21 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034a238525914e419d92fe6eeea0eaff21 2023-02-13 10:08:35,454 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:35,467 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:35,468 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46146, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:35,475 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:35,476 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:35,488 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0ef500458ffe4804aeefda9d203c8517 first=Optional[r5] last=Optional[r6] 2023-02-13 10:08:35,488 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0ef500458ffe4804aeefda9d203c8517}] 2023-02-13 10:08:35,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0ef500458ffe4804aeefda9d203c8517 for inclusion in 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:35,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 10:08:35,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:35,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:35,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0ef500458ffe4804aeefda9d203c8517 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kn09mk5qd0tv9gk3mppb69rjv1dtjfebjkfgtcclgceus793cregv5v8c25lnrf5/family1/0ef500458ffe4804aeefda9d203c8517 2023-02-13 10:08:35,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kn09mk5qd0tv9gk3mppb69rjv1dtjfebjkfgtcclgceus793cregv5v8c25lnrf5/family1/0ef500458ffe4804aeefda9d203c8517 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_ 2023-02-13 10:08:35,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kn09mk5qd0tv9gk3mppb69rjv1dtjfebjkfgtcclgceus793cregv5v8c25lnrf5/family1/0ef500458ffe4804aeefda9d203c8517 into 1cad52cf8b278bc4b5803d83efcec02c/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_ - updating store file list. 2023-02-13 10:08:35,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_ into 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:35,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kn09mk5qd0tv9gk3mppb69rjv1dtjfebjkfgtcclgceus793cregv5v8c25lnrf5/family1/0ef500458ffe4804aeefda9d203c8517 into 1cad52cf8b278bc4b5803d83efcec02c/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_) 2023-02-13 10:08:35,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kn09mk5qd0tv9gk3mppb69rjv1dtjfebjkfgtcclgceus793cregv5v8c25lnrf5/family1/0ef500458ffe4804aeefda9d203c8517 2023-02-13 10:08:35,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:08:35,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:08:35,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): 1cad52cf8b278bc4b5803d83efcec02c/family1 is initiating minor compaction 2023-02-13 10:08:35,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30749fa9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:35,510 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1cad52cf8b278bc4b5803d83efcec02c/family1 in testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:35,511 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp, totalSize=49.7 K 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting e3488f005bcc4d0ab0c38be0a3cc99c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 7d67ec39987843039ee7d0866b36c1c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 821e95d090d642eda508b0ff0a6cddd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 9e48344535f44bd9b7e3e5e02c7f9a2f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting ec5b4ab91c114a818d48824cf4a055ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting cb79aa3965bd4c61b2c9c96b5ed12ee4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 3dee1c677f494eadade9ae24e343bbcb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting d65f06a376fa49349c47868c04052817, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 46ed55532f7c4104be80175528e03baa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:08:35,511 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:08:35,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:35,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:35,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd50c9ba35947aebc03c7785c7f318f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd50c9ba35947aebc03c7785c7f318f 2023-02-13 10:08:35,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033a1b452330b842ae9fdeb20b6f4116e3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033a1b452330b842ae9fdeb20b6f4116e3 2023-02-13 10:08:35,516 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 10:08:35,516 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 10:08:35,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:35,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:35,561 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1cad52cf8b278bc4b5803d83efcec02c#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:36,386 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123164b7560696044bcd88eaca3c700b8db3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123164b7560696044bcd88eaca3c700b8db3 2023-02-13 10:08:36,386 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/342d1e7b67354715bd4bcb398667739f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/342d1e7b67354715bd4bcb398667739f 2023-02-13 10:08:36,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:36,392 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1cad52cf8b278bc4b5803d83efcec02c/family1 of 1cad52cf8b278bc4b5803d83efcec02c into 342d1e7b67354715bd4bcb398667739f(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:08:36,392 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:36,392 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676282915510; duration=0sec 2023-02-13 10:08:36,392 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:36,412 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5887482ba989435a8d7c1583debfc156 first=Optional[r1] last=Optional[r4] 2023-02-13 10:08:36,413 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5887482ba989435a8d7c1583debfc156}] 2023-02-13 10:08:36,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5887482ba989435a8d7c1583debfc156 for inclusion in 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 10:08:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:36,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5887482ba989435a8d7c1583debfc156 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brb16q6ku67ekqv6rfmihnclstjask08uqcvog1cbnkm474bf2vlktqtpej2i9bt/family1/5887482ba989435a8d7c1583debfc156 2023-02-13 10:08:36,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brb16q6ku67ekqv6rfmihnclstjask08uqcvog1cbnkm474bf2vlktqtpej2i9bt/family1/5887482ba989435a8d7c1583debfc156 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_ 2023-02-13 10:08:36,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brb16q6ku67ekqv6rfmihnclstjask08uqcvog1cbnkm474bf2vlktqtpej2i9bt/family1/5887482ba989435a8d7c1583debfc156 into 1cad52cf8b278bc4b5803d83efcec02c/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_ - updating store file list. 2023-02-13 10:08:36,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_ into 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:36,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brb16q6ku67ekqv6rfmihnclstjask08uqcvog1cbnkm474bf2vlktqtpej2i9bt/family1/5887482ba989435a8d7c1583debfc156 into 1cad52cf8b278bc4b5803d83efcec02c/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_) 2023-02-13 10:08:36,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brb16q6ku67ekqv6rfmihnclstjask08uqcvog1cbnkm474bf2vlktqtpej2i9bt/family1/5887482ba989435a8d7c1583debfc156 2023-02-13 10:08:36,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:08:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:08:36,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): 1cad52cf8b278bc4b5803d83efcec02c/family1 is initiating minor compaction (all files) 2023-02-13 10:08:36,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9d5b7ad; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 10:08:36,428 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1cad52cf8b278bc4b5803d83efcec02c/family1 in testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:08:36,428 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/342d1e7b67354715bd4bcb398667739f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp, totalSize=178.1 K 2023-02-13 10:08:36,429 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 6447258d9df2465ebb85e6c44091cad9, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:08:36,429 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 342d1e7b67354715bd4bcb398667739f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:08:36,430 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting f793c27a90314826a326923c156c65ec_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206172 2023-02-13 10:08:36,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:36,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:36,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac725f4e52d34abe943c95c275652719 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac725f4e52d34abe943c95c275652719 2023-02-13 10:08:36,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120575b035c2cd59476e915064c2be73ff4b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120575b035c2cd59476e915064c2be73ff4b 2023-02-13 10:08:36,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9d171da5f3b45d49fc03b8f40d41ca3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9d171da5f3b45d49fc03b8f40d41ca3 2023-02-13 10:08:36,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbfde755c03a4184aa885402915ac7c7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbfde755c03a4184aa885402915ac7c7 2023-02-13 10:08:36,438 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 10:08:36,438 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 10:08:36,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:36,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:36,455 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1cad52cf8b278bc4b5803d83efcec02c#family1#compaction#23 average throughput is 11.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:36,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_] to archive 2023-02-13 10:08:36,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:36,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/e3488f005bcc4d0ab0c38be0a3cc99c2 2023-02-13 10:08:36,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/7d67ec39987843039ee7d0866b36c1c8 2023-02-13 10:08:36,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/821e95d090d642eda508b0ff0a6cddd8 2023-02-13 10:08:36,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/9e48344535f44bd9b7e3e5e02c7f9a2f 2023-02-13 10:08:36,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/ec5b4ab91c114a818d48824cf4a055ed 2023-02-13 10:08:36,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/cb79aa3965bd4c61b2c9c96b5ed12ee4 2023-02-13 10:08:36,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/3dee1c677f494eadade9ae24e343bbcb 2023-02-13 10:08:36,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/d65f06a376fa49349c47868c04052817 2023-02-13 10:08:36,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/46ed55532f7c4104be80175528e03baa 2023-02-13 10:08:36,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/aa0851763c67458a8b0b8946ed5cdcaa_SeqId_44_ 2023-02-13 10:08:36,516 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c9670dae1142423b8da33feb737138be to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c9670dae1142423b8da33feb737138be 2023-02-13 10:08:36,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:36,544 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1be057b19edb4bdab859b76d79b854bc first=Optional[r00] last=Optional[r8] 2023-02-13 10:08:36,545 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1be057b19edb4bdab859b76d79b854bc}] 2023-02-13 10:08:36,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1be057b19edb4bdab859b76d79b854bc for inclusion in 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:36,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 10:08:36,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:36,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:36,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1be057b19edb4bdab859b76d79b854bc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q79f7bu83f0iqf8eign5c56rcu8unn1s8f4thd59oc5vb044q7cco19aeovd30si/family1/1be057b19edb4bdab859b76d79b854bc 2023-02-13 10:08:36,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q79f7bu83f0iqf8eign5c56rcu8unn1s8f4thd59oc5vb044q7cco19aeovd30si/family1/1be057b19edb4bdab859b76d79b854bc as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/8f551795182b4c159be23bcd2f8db15f_SeqId_49_ 2023-02-13 10:08:36,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q79f7bu83f0iqf8eign5c56rcu8unn1s8f4thd59oc5vb044q7cco19aeovd30si/family1/1be057b19edb4bdab859b76d79b854bc into 1cad52cf8b278bc4b5803d83efcec02c/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/8f551795182b4c159be23bcd2f8db15f_SeqId_49_ - updating store file list. 2023-02-13 10:08:36,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/8f551795182b4c159be23bcd2f8db15f_SeqId_49_ into 1cad52cf8b278bc4b5803d83efcec02c/family1 2023-02-13 10:08:36,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q79f7bu83f0iqf8eign5c56rcu8unn1s8f4thd59oc5vb044q7cco19aeovd30si/family1/1be057b19edb4bdab859b76d79b854bc into 1cad52cf8b278bc4b5803d83efcec02c/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/8f551795182b4c159be23bcd2f8db15f_SeqId_49_) 2023-02-13 10:08:36,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q79f7bu83f0iqf8eign5c56rcu8unn1s8f4thd59oc5vb044q7cco19aeovd30si/family1/1be057b19edb4bdab859b76d79b854bc 2023-02-13 10:08:36,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:36,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:36,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120533f4af966644a16bc247a027f0e6b55 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120533f4af966644a16bc247a027f0e6b55 2023-02-13 10:08:36,572 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288a737a968eba4f198880c54be881d1eb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288a737a968eba4f198880c54be881d1eb 2023-02-13 10:08:36,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113047042fb6df16459ca83e5a57518db9a8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113047042fb6df16459ca83e5a57518db9a8 2023-02-13 10:08:36,573 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 10:08:36,573 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 10:08:36,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:36,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:36,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:08:36,574 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:08:36,574 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:36,576 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:36,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9760 sec 2023-02-13 10:08:36,679 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=261 (was 247) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35104 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35074 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:34972 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1717170749_15 at /127.0.0.1:35256 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35072 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35068 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35152 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x23996b07-SendThread(127.0.0.1:57475) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318cc924a6097644428939616a6ce1ce7c_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35110 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35034 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35166 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x23996b07 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1462197654.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1454032713-188.40.62.62-1676282876222:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/afe1b85e68ae48eeacf35307897d8891 block BP-1454032713-188.40.62.62-1676282876222:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: ResponseProcessor for block BP-1454032713-188.40.62.62-1676282876222:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0xcbad5a7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35094 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35160 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35128 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35116 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:34996 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-484 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35140 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1717170749_15 at /127.0.0.1:35008 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xcbad5a7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038626093_15 at /127.0.0.1:35086 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57475@0x23996b07-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1717170749_15 at /127.0.0.1:35228 [Receiving block BP-1454032713-188.40.62.62-1676282876222:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=621 (was 584) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 252), ProcessCount=168 (was 168), AvailableMemoryMB=6504 (was 6581) 2023-02-13 10:08:36,690 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=168, AvailableMemoryMB=6502 2023-02-13 10:08:36,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:08:36,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:36,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:36,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-13 10:08:36,697 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:36,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:36,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:36,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca empty. 2023-02-13 10:08:36,700 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:36,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-13 10:08:36,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:37,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:37,110 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:37,111 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7bad36d3e3feba9df3f34650d0420ca, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:37,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:37,521 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:37,522 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing c7bad36d3e3feba9df3f34650d0420ca, disabling compactions & flushes 2023-02-13 10:08:37,522 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,522 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,522 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. after waiting 0 ms 2023-02-13 10:08:37,522 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,523 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,523 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for c7bad36d3e3feba9df3f34650d0420ca: Waiting for close lock at 1676282917522Disabling compacts and flushes for region at 1676282917522Disabling writes for close at 1676282917522Writing region close event to WAL at 1676282917522Closed at 1676282917522 2023-02-13 10:08:37,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:37,559 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282917558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282917558"}]},"ts":"1676282917558"} 2023-02-13 10:08:37,563 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:08:37,565 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:37,566 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282917566"}]},"ts":"1676282917566"} 2023-02-13 10:08:37,568 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 10:08:37,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7bad36d3e3feba9df3f34650d0420ca, ASSIGN}] 2023-02-13 10:08:37,619 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7bad36d3e3feba9df3f34650d0420ca, ASSIGN 2023-02-13 10:08:37,622 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7bad36d3e3feba9df3f34650d0420ca, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:37,698 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/.tmp/family1/afe1b85e68ae48eeacf35307897d8891 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/afe1b85e68ae48eeacf35307897d8891 2023-02-13 10:08:37,709 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1cad52cf8b278bc4b5803d83efcec02c/family1 of 1cad52cf8b278bc4b5803d83efcec02c into afe1b85e68ae48eeacf35307897d8891(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:08:37,709 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1cad52cf8b278bc4b5803d83efcec02c: 2023-02-13 10:08:37,709 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676282916428; duration=1sec 2023-02-13 10:08:37,710 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:37,773 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c7bad36d3e3feba9df3f34650d0420ca, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:37,774 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282917773"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282917773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282917773"}]},"ts":"1676282917773"} 2023-02-13 10:08:37,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure c7bad36d3e3feba9df3f34650d0420ca, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:37,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/342d1e7b67354715bd4bcb398667739f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_] to archive 2023-02-13 10:08:37,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:37,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/6447258d9df2465ebb85e6c44091cad9 2023-02-13 10:08:37,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/342d1e7b67354715bd4bcb398667739f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/342d1e7b67354715bd4bcb398667739f 2023-02-13 10:08:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:37,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/family1/f793c27a90314826a326923c156c65ec_SeqId_47_ 2023-02-13 10:08:37,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7bad36d3e3feba9df3f34650d0420ca, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:37,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:37,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,942 INFO [StoreOpener-c7bad36d3e3feba9df3f34650d0420ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,945 DEBUG [StoreOpener-c7bad36d3e3feba9df3f34650d0420ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:37,945 DEBUG [StoreOpener-c7bad36d3e3feba9df3f34650d0420ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:37,945 INFO [StoreOpener-c7bad36d3e3feba9df3f34650d0420ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7bad36d3e3feba9df3f34650d0420ca columnFamilyName family1 2023-02-13 10:08:37,947 INFO [StoreOpener-c7bad36d3e3feba9df3f34650d0420ca-1] regionserver.HStore(310): Store=c7bad36d3e3feba9df3f34650d0420ca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:37,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:08:37,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:37,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened c7bad36d3e3feba9df3f34650d0420ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64533483, jitterRate=-0.03837616741657257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:37,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for c7bad36d3e3feba9df3f34650d0420ca: Running coprocessor pre-open hook at 1676282917939Writing region info on filesystem at 1676282917939Initializing all the Stores at 1676282917941 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282917942 (+1 ms)Cleaning up temporary data from old regions at 1676282917950 (+8 ms)Cleaning up detritus from prior splits at 1676282917950Running coprocessor post-open hooks at 1676282917956 (+6 ms)Region opened successfully at 1676282917956 2023-02-13 10:08:37,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca., pid=25, masterSystemTime=1676282917929 2023-02-13 10:08:37,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:37,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c7bad36d3e3feba9df3f34650d0420ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:37,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282917958"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282917958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282917958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282917958"}]},"ts":"1676282917958"} 2023-02-13 10:08:37,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-13 10:08:37,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure c7bad36d3e3feba9df3f34650d0420ca, server=jenkins-hbase16.apache.org,38311,1676282881622 in 184 msec 2023-02-13 10:08:37,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-13 10:08:37,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7bad36d3e3feba9df3f34650d0420ca, ASSIGN in 346 msec 2023-02-13 10:08:37,964 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:37,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282917964"}]},"ts":"1676282917964"} 2023-02-13 10:08:37,965 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 10:08:38,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:38,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.3070 sec 2023-02-13 10:08:38,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 10:08:38,807 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-13 10:08:38,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:38,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,844 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:38,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:38,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:38,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:38,845 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,845 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,873 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:38,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:38,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:38,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:38,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:38,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:38,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:38,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:38,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:38,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:38,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:38,875 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:38,875 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:38,875 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:38,876 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:08:39,314 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113034d64a7d84ab45078c1c1ff496742245 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113034d64a7d84ab45078c1c1ff496742245 2023-02-13 10:08:39,318 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/6b1b319ed8d24857b3fcbd2afd3535f1 2023-02-13 10:08:39,323 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/6b1b319ed8d24857b3fcbd2afd3535f1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1 2023-02-13 10:08:39,329 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 10:08:39,330 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 454ms, sequenceid=5, compaction requested=false 2023-02-13 10:08:39,330 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:39,331 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:39,331 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:39,331 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:39,331 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:39,331 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,331 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:39,331 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:39,340 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:39,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:39,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:39,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:39,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:39,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:39,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:39,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d0e2724[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:39,343 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:39,343 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,348 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,348 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:39,348 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:39,349 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:39,349 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,349 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:39,407 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:39,407 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:39,407 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,407 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:39,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:39,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:39,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:39,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:39,419 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:39,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:39,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:39,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,419 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:39,431 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,431 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:39,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,431 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:39,432 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,435 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:39,448 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:39,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:39,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:39,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:39,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:39,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:39,448 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,449 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,549 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:39,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:39,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:39,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:39,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,565 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:39,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:39,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:39,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:39,566 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,566 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,573 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:39,573 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:39,574 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:39,574 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,577 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:39,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:39,577 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:39,577 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:39,578 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:39,578 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:39,578 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:39,578 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:39,578 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:39,578 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:08:40,003 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128124fc150f08e4bc3b929e074e8506d33 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128124fc150f08e4bc3b929e074e8506d33 2023-02-13 10:08:40,414 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/f9276502feb248c8874d7b9f991f014a 2023-02-13 10:08:40,428 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/f9276502feb248c8874d7b9f991f014a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a 2023-02-13 10:08:40,438 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:08:40,439 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 861ms, sequenceid=9, compaction requested=false 2023-02-13 10:08:40,439 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:40,440 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:40,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:40,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:40,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:40,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:40,473 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,473 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:40,474 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,474 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:40,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:40,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3461b07c[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:40,476 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:40,477 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,481 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,482 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:40,482 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:40,482 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:40,482 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,482 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:40,490 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:40,490 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,490 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:40,490 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:40,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:40,497 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:40,497 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:40,497 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:40,497 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,497 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:40,507 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,507 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:40,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:40,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,507 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:40,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:40,508 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,512 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:40,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:40,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,523 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:40,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:40,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:40,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:40,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:40,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:40,524 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,524 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:40,524 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,524 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:40,524 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,525 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:40,625 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:40,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:40,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:40,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:40,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,637 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:40,637 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:40,637 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:40,637 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:40,638 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,638 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,648 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:40,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:40,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:40,649 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:40,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:40,650 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:40,650 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:40,650 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:40,650 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:40,650 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:40,650 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:40,650 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:40,650 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:41,070 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201edd80b7f195944f6ad31a910be2ac661 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201edd80b7f195944f6ad31a910be2ac661 2023-02-13 10:08:41,478 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/ffb9b53052d94466b455323b4f6b1673 2023-02-13 10:08:41,488 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/ffb9b53052d94466b455323b4f6b1673 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673 2023-02-13 10:08:41,493 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 10:08:41,494 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 844ms, sequenceid=13, compaction requested=true 2023-02-13 10:08:41,494 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:41,494 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:41,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:41,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:41,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:41,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:41,523 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,523 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:41,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:41,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:41,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb7702d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:41,527 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:41,527 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,531 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:41,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:41,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:41,532 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,532 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:41,540 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:41,540 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:41,540 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:41,540 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:41,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:41,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:41,549 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:41,549 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:41,549 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:41,549 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,549 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:41,556 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,557 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:41,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,557 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:41,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:41,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,561 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,591 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,591 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:41,591 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:41,592 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:41,592 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:41,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:41,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:41,592 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,592 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,592 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,592 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:41,593 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:41,593 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:41,593 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:41,693 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:41,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:41,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:41,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:41,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,708 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:41,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:41,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:41,709 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:41,709 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,709 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,723 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,723 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:41,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:41,723 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:41,723 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:41,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:41,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:41,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:41,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:41,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:41,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:41,725 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:41,725 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:41,725 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:42,148 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055d71258ddab64bb8a44e42393cd346f6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055d71258ddab64bb8a44e42393cd346f6 2023-02-13 10:08:42,557 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/c244af4ed5004584a63d9f99b21b45b7 2023-02-13 10:08:42,568 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/c244af4ed5004584a63d9f99b21b45b7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7 2023-02-13 10:08:42,575 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 10:08:42,576 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 851ms, sequenceid=17, compaction requested=true 2023-02-13 10:08:42,576 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:42,576 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:42,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:42,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:42,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:42,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:42,615 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,615 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:42,615 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,615 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:42,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:42,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@501c4521[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:42,617 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:42,617 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,623 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:42,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:42,623 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,623 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:42,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:42,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:42,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:42,631 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:42,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:42,634 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:42,635 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:42,635 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:42,635 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,635 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:42,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:42,640 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,641 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:42,648 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:42,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:42,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:42,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:42,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:42,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:42,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:42,649 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,749 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:42,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:42,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:42,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:42,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,760 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:42,760 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:42,760 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:42,760 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:42,761 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,761 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,765 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:42,765 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:42,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:42,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:42,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:42,768 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:42,768 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:42,768 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:42,769 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:42,769 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:42,769 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:42,769 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:42,769 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:43,194 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228559fb0637c7a43c5bc2275f23f78e2e7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228559fb0637c7a43c5bc2275f23f78e2e7 2023-02-13 10:08:43,495 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:08:43,495 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:08:43,495 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23996b07 to 127.0.0.1:57475 2023-02-13 10:08:43,495 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:08:43,496 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:08:43,496 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30a1f021 to 127.0.0.1:57475 2023-02-13 10:08:43,496 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:08:43,497 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:08:43,497 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30ffdef6 to 127.0.0.1:57475 2023-02-13 10:08:43,497 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:08:43,603 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/5ed571f9f9314cbcaf5dfffcd5db21dd 2023-02-13 10:08:43,610 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/5ed571f9f9314cbcaf5dfffcd5db21dd as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd 2023-02-13 10:08:43,615 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 10:08:43,616 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 847ms, sequenceid=21, compaction requested=true 2023-02-13 10:08:43,616 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:43,616 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:43,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:43,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:43,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:43,616 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:43,623 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:43,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:43,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:43,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:43,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cd77f01[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:43,625 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:43,625 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,631 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:43,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:43,631 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,632 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:43,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:43,639 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:43,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,639 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:43,640 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:43,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:43,642 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:43,642 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:43,642 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:43,642 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,642 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:43,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,648 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:43,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,648 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:43,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,650 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,656 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:43,656 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:43,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:43,656 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:43,656 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:43,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:43,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:43,656 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:43,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,657 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,757 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:43,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:43,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:43,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,766 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:43,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:43,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:43,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:43,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,766 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,781 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:43,781 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:43,782 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:43,782 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,784 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:43,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:43,784 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:43,784 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:43,784 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:43,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:43,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:43,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:43,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:43,785 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:44,203 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317992df67de714e1687c2a11f3e7ee0da to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317992df67de714e1687c2a11f3e7ee0da 2023-02-13 10:08:44,611 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/47420e3f9c9f41979ee4260086b8e8ed 2023-02-13 10:08:44,617 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/47420e3f9c9f41979ee4260086b8e8ed as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed 2023-02-13 10:08:44,623 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 10:08:44,624 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 839ms, sequenceid=25, compaction requested=true 2023-02-13 10:08:44,624 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:44,624 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:44,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:44,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:44,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:44,624 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:44,631 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:44,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,632 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:44,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:44,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@150cd8b7[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:44,633 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:44,633 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,690 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:44,690 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,690 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:44,690 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:44,690 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:44,727 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:44,728 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:44,728 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:44,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:44,730 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:44,730 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:44,730 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:44,730 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,730 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:44,739 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,739 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,739 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:44,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:44,740 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,741 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:44,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,748 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:44,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:44,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:44,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:44,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:44,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,748 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,749 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,749 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:44,749 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:44,849 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:44,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:44,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:44,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:44,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,861 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:44,861 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:44,861 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:44,861 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:44,862 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,862 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:44,873 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:44,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:44,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:44,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:44,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:44,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:44,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:44,876 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:44,876 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:44,876 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:44,877 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:44,877 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:44,877 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:44,877 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:44,877 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:45,303 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011ab6a77394dc4942b1e6121d2f46140c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab6a77394dc4942b1e6121d2f46140c 2023-02-13 10:08:45,712 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/c08ecc385dc14897bd8c8efccd0a7f56 2023-02-13 10:08:45,725 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/c08ecc385dc14897bd8c8efccd0a7f56 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56 2023-02-13 10:08:45,733 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 10:08:45,734 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 857ms, sequenceid=29, compaction requested=true 2023-02-13 10:08:45,734 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:45,734 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:45,734 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:45,734 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:45,735 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,735 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:45,735 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:45,764 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,764 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:45,765 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,765 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:45,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:45,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@250ae423[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:45,768 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:45,768 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,773 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:45,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:45,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:45,773 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,773 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:45,781 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:45,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:45,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:45,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:45,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:45,789 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:45,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:45,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:45,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,789 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:45,798 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,798 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:45,798 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:45,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:45,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:45,799 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,802 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,815 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:45,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:45,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:45,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:45,816 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:45,816 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:45,815 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:45,816 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,916 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:45,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:45,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:45,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:45,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,932 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:45,932 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:45,932 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:45,932 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:45,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,933 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,939 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:45,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:45,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:45,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,941 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:45,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:45,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:45,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:45,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:45,944 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:45,944 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:45,944 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:45,944 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:45,944 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:46,369 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034431e9cc89e8499e9ea5ebf9c09858ed to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034431e9cc89e8499e9ea5ebf9c09858ed 2023-02-13 10:08:46,779 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/8c843ad3195e4f25b505469a6e4c80c3 2023-02-13 10:08:46,793 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/8c843ad3195e4f25b505469a6e4c80c3 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3 2023-02-13 10:08:46,802 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 10:08:46,803 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 859ms, sequenceid=33, compaction requested=true 2023-02-13 10:08:46,804 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:46,804 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:46,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:46,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:46,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:46,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:46,831 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,831 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:46,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:46,832 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,832 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:46,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:46,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@178d88ee[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:46,837 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:46,837 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,848 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,848 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:46,849 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:46,849 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:46,849 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,849 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:46,856 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:46,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:46,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:46,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:46,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:46,866 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:46,867 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:46,867 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:46,867 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,867 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:46,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:46,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:46,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:46,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,877 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:46,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:46,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:46,890 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:46,890 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:46,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:46,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:46,891 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:46,891 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:46,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:46,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:46,991 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:46,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:47,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:47,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:47,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,008 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:47,008 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:47,008 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:47,008 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:47,009 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,009 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,015 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,015 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:47,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:47,015 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,015 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:47,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,018 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:47,018 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:47,018 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:47,018 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:47,018 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:47,018 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:47,018 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:47,018 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:47,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907855eb5716d8b415187af5b8a7e92f200 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907855eb5716d8b415187af5b8a7e92f200 2023-02-13 10:08:47,851 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/94c02461d96442cfbb627a7da3ba2008 2023-02-13 10:08:47,863 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/94c02461d96442cfbb627a7da3ba2008 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008 2023-02-13 10:08:47,869 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 10:08:47,871 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 853ms, sequenceid=37, compaction requested=true 2023-02-13 10:08:47,871 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:47,871 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:47,871 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:47,871 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:47,871 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,871 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:47,871 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:47,945 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,945 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:47,946 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,946 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:47,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:47,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b5d269[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:47,951 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:47,951 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,965 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,965 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:47,965 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:47,965 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:47,966 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,966 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:47,973 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:47,973 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:47,973 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:47,973 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:47,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:47,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:47,984 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:47,985 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:47,985 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:47,985 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,985 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:47,997 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,997 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:47,997 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:47,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:47,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:47,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:47,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:47,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,999 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:47,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,006 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:48,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:48,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:48,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,007 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,007 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:48,007 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:48,007 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:48,107 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:48,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:48,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,120 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:48,121 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:48,121 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:48,121 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:48,122 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,122 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,131 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:48,131 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:48,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:48,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:48,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:48,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,133 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:48,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:48,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:48,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:48,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:48,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:48,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:48,133 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:48,133 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. started... 2023-02-13 10:08:48,133 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c7bad36d3e3feba9df3f34650d0420ca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:48,546 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120523b515f651445ab870a8089b7cf092c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120523b515f651445ab870a8089b7cf092c 2023-02-13 10:08:48,954 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/df37c6d4bff6459a81eb85647a649f4b 2023-02-13 10:08:48,967 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/df37c6d4bff6459a81eb85647a649f4b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b 2023-02-13 10:08:48,973 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 10:08:48,974 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7bad36d3e3feba9df3f34650d0420ca in 841ms, sequenceid=41, compaction requested=true 2023-02-13 10:08:48,974 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:48,974 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:48,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:48,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:48,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:48,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:48,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:49,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,006 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:49,007 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,007 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:49,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:49,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738f7ba8[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:49,012 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:49,012 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,023 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:49,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:49,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:49,024 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,024 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:49,031 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:49,031 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,031 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:49,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:49,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:49,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:49,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:49,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:49,042 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:49,042 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:49,042 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:49,042 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,042 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:49,048 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,048 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:49,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:49,048 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:49,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:49,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:49,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:49,049 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:49,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,052 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,064 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:49,065 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:49,064 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:49,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:49,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 10:08:49,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:49,065 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:49,065 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:49,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:49,065 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,066 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:49,166 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:49,172 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-13 10:08:49,174 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:49,175 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:49,177 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:49,177 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283529177 2023-02-13 10:08:49,180 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:08:49,182 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 10:08:49,182 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:49,182 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x030477d0 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:49,241 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59c98dfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:49,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,710 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103147e3e23113147a2b6411d4b68dc6705 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103147e3e23113147a2b6411d4b68dc6705 2023-02-13 10:08:49,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:49,722 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:49,723 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:49,731 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:49,732 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47426, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:49,742 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/144e8eefcc184ed7b6752016d8c6a165 first=Optional[r3] last=Optional[r6] 2023-02-13 10:08:49,743 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/144e8eefcc184ed7b6752016d8c6a165}] 2023-02-13 10:08:49,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/144e8eefcc184ed7b6752016d8c6a165 for inclusion in c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 10:08:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:49,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/144e8eefcc184ed7b6752016d8c6a165 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b6eta8lkavlkrk8pbvo5jlef82o4hre6pr4fll2cro2p8eqg1plu3p4gjt153jdu/family1/144e8eefcc184ed7b6752016d8c6a165 2023-02-13 10:08:49,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b6eta8lkavlkrk8pbvo5jlef82o4hre6pr4fll2cro2p8eqg1plu3p4gjt153jdu/family1/144e8eefcc184ed7b6752016d8c6a165 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_ 2023-02-13 10:08:49,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b6eta8lkavlkrk8pbvo5jlef82o4hre6pr4fll2cro2p8eqg1plu3p4gjt153jdu/family1/144e8eefcc184ed7b6752016d8c6a165 into c7bad36d3e3feba9df3f34650d0420ca/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_ - updating store file list. 2023-02-13 10:08:49,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_ into c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:49,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b6eta8lkavlkrk8pbvo5jlef82o4hre6pr4fll2cro2p8eqg1plu3p4gjt153jdu/family1/144e8eefcc184ed7b6752016d8c6a165 into c7bad36d3e3feba9df3f34650d0420ca/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_) 2023-02-13 10:08:49,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b6eta8lkavlkrk8pbvo5jlef82o4hre6pr4fll2cro2p8eqg1plu3p4gjt153jdu/family1/144e8eefcc184ed7b6752016d8c6a165 2023-02-13 10:08:49,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:08:49,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:08:49,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): c7bad36d3e3feba9df3f34650d0420ca/family1 is initiating minor compaction 2023-02-13 10:08:49,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6ae52500; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:49,765 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c7bad36d3e3feba9df3f34650d0420ca/family1 in testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:49,766 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp, totalSize=50.0 K 2023-02-13 10:08:49,766 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting f9276502feb248c8874d7b9f991f014a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:08:49,766 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting ffb9b53052d94466b455323b4f6b1673, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:08:49,766 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting c244af4ed5004584a63d9f99b21b45b7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:08:49,766 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 5ed571f9f9314cbcaf5dfffcd5db21dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:08:49,766 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 47420e3f9c9f41979ee4260086b8e8ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:08:49,767 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting c08ecc385dc14897bd8c8efccd0a7f56, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:08:49,767 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 8c843ad3195e4f25b505469a6e4c80c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:08:49,767 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 94c02461d96442cfbb627a7da3ba2008, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:08:49,767 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting df37c6d4bff6459a81eb85647a649f4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:08:49,767 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 1183fe7e3da84e618f8038e52703a949_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:08:49,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:49,769 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:49,771 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228559fb0637c7a43c5bc2275f23f78e2e7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228559fb0637c7a43c5bc2275f23f78e2e7 2023-02-13 10:08:49,772 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317992df67de714e1687c2a11f3e7ee0da to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317992df67de714e1687c2a11f3e7ee0da 2023-02-13 10:08:49,773 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab6a77394dc4942b1e6121d2f46140c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab6a77394dc4942b1e6121d2f46140c 2023-02-13 10:08:49,774 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034431e9cc89e8499e9ea5ebf9c09858ed to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034431e9cc89e8499e9ea5ebf9c09858ed 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 10:08:49,775 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:49,797 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7bad36d3e3feba9df3f34650d0420ca#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:50,215 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/a234c5cc198247fa9be14120bb151307 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/a234c5cc198247fa9be14120bb151307 2023-02-13 10:08:50,223 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c7bad36d3e3feba9df3f34650d0420ca/family1 of c7bad36d3e3feba9df3f34650d0420ca into a234c5cc198247fa9be14120bb151307(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:08:50,223 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:50,223 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676282929765; duration=0sec 2023-02-13 10:08:50,223 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:50,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_] to archive 2023-02-13 10:08:50,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:50,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/f9276502feb248c8874d7b9f991f014a 2023-02-13 10:08:50,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/ffb9b53052d94466b455323b4f6b1673 2023-02-13 10:08:50,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c244af4ed5004584a63d9f99b21b45b7 2023-02-13 10:08:50,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/5ed571f9f9314cbcaf5dfffcd5db21dd 2023-02-13 10:08:50,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/47420e3f9c9f41979ee4260086b8e8ed 2023-02-13 10:08:50,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/c08ecc385dc14897bd8c8efccd0a7f56 2023-02-13 10:08:50,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/8c843ad3195e4f25b505469a6e4c80c3 2023-02-13 10:08:50,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/94c02461d96442cfbb627a7da3ba2008 2023-02-13 10:08:50,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/df37c6d4bff6459a81eb85647a649f4b 2023-02-13 10:08:50,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/1183fe7e3da84e618f8038e52703a949_SeqId_44_ 2023-02-13 10:08:50,615 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056aac640e5e2c4fc387a7212beb8c5449 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056aac640e5e2c4fc387a7212beb8c5449 2023-02-13 10:08:50,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:50,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bc993facdc3b49d2b5985eec17f46712 first=Optional[r1] last=Optional[r2] 2023-02-13 10:08:50,643 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bc993facdc3b49d2b5985eec17f46712}] 2023-02-13 10:08:50,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bc993facdc3b49d2b5985eec17f46712 for inclusion in c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 10:08:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:08:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:50,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bc993facdc3b49d2b5985eec17f46712 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k0p1alhppoukmvpcvjrq3qt04alboibp81rmbnvvns2hebhvfsrfv8t2ifhhms8c/family1/bc993facdc3b49d2b5985eec17f46712 2023-02-13 10:08:50,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k0p1alhppoukmvpcvjrq3qt04alboibp81rmbnvvns2hebhvfsrfv8t2ifhhms8c/family1/bc993facdc3b49d2b5985eec17f46712 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_ 2023-02-13 10:08:50,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k0p1alhppoukmvpcvjrq3qt04alboibp81rmbnvvns2hebhvfsrfv8t2ifhhms8c/family1/bc993facdc3b49d2b5985eec17f46712 into c7bad36d3e3feba9df3f34650d0420ca/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_ - updating store file list. 2023-02-13 10:08:50,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_ into c7bad36d3e3feba9df3f34650d0420ca/family1 2023-02-13 10:08:50,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k0p1alhppoukmvpcvjrq3qt04alboibp81rmbnvvns2hebhvfsrfv8t2ifhhms8c/family1/bc993facdc3b49d2b5985eec17f46712 into c7bad36d3e3feba9df3f34650d0420ca/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_) 2023-02-13 10:08:50,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k0p1alhppoukmvpcvjrq3qt04alboibp81rmbnvvns2hebhvfsrfv8t2ifhhms8c/family1/bc993facdc3b49d2b5985eec17f46712 2023-02-13 10:08:50,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:08:50,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:08:50,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): c7bad36d3e3feba9df3f34650d0420ca/family1 is initiating minor compaction (all files) 2023-02-13 10:08:50,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@742ea9c3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:50,660 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c7bad36d3e3feba9df3f34650d0420ca/family1 in testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:08:50,660 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/a234c5cc198247fa9be14120bb151307, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp, totalSize=176.8 K 2023-02-13 10:08:50,661 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 6b1b319ed8d24857b3fcbd2afd3535f1, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:08:50,661 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting a234c5cc198247fa9be14120bb151307, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:08:50,661 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 48261fec070e4ab79f2def0e554bea5a_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206172 2023-02-13 10:08:50,662 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:50,662 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:50,664 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201edd80b7f195944f6ad31a910be2ac661 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201edd80b7f195944f6ad31a910be2ac661 2023-02-13 10:08:50,668 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055d71258ddab64bb8a44e42393cd346f6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055d71258ddab64bb8a44e42393cd346f6 2023-02-13 10:08:50,668 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-13 10:08:50,668 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 10:08:50,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:08:50,669 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:08:50,669 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:50,670 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:08:50,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4970 sec 2023-02-13 10:08:50,684 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7bad36d3e3feba9df3f34650d0420ca#family1#compaction#35 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:50,757 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=251 (was 261), OpenFileDescriptor=589 (was 621), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 197), ProcessCount=166 (was 168), AvailableMemoryMB=7896 (was 6502) - AvailableMemoryMB LEAK? - 2023-02-13 10:08:50,767 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=166, AvailableMemoryMB=7896 2023-02-13 10:08:50,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 10:08:50,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:50,773 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:50,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-13 10:08:50,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:50,774 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:50,776 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:50,776 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:50,776 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813 empty. 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448 empty. 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931 empty. 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:50,777 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:50,777 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-13 10:08:50,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:51,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:51,188 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:51,191 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => ec71b4d134f40901c4ce961630ab2813, NAME => 'testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:51,191 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5f41dd240b983d854e23cd954e027448, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:51,192 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 30df5af140d7623958af3d33dc87c931, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:51,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:51,606 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:51,606 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:51,606 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing ec71b4d134f40901c4ce961630ab2813, disabling compactions & flushes 2023-02-13 10:08:51,607 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 5f41dd240b983d854e23cd954e027448, disabling compactions & flushes 2023-02-13 10:08:51,607 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:51,607 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:51,607 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:51,607 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 30df5af140d7623958af3d33dc87c931, disabling compactions & flushes 2023-02-13 10:08:51,608 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. after waiting 0 ms 2023-02-13 10:08:51,607 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. after waiting 0 ms 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:51,608 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:51,608 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:51,609 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:51,609 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for ec71b4d134f40901c4ce961630ab2813: Waiting for close lock at 1676282931606Disabling compacts and flushes for region at 1676282931606Disabling writes for close at 1676282931608 (+2 ms)Writing region close event to WAL at 1676282931608Closed at 1676282931608 2023-02-13 10:08:51,609 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 30df5af140d7623958af3d33dc87c931: Waiting for close lock at 1676282931607Disabling compacts and flushes for region at 1676282931607Disabling writes for close at 1676282931608 (+1 ms)Writing region close event to WAL at 1676282931609 (+1 ms)Closed at 1676282931609 2023-02-13 10:08:51,609 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. after waiting 0 ms 2023-02-13 10:08:51,609 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:51,609 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:51,609 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 5f41dd240b983d854e23cd954e027448: Waiting for close lock at 1676282931607Disabling compacts and flushes for region at 1676282931607Disabling writes for close at 1676282931609 (+2 ms)Writing region close event to WAL at 1676282931609Closed at 1676282931609 2023-02-13 10:08:51,613 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:51,615 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282931615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282931615"}]},"ts":"1676282931615"} 2023-02-13 10:08:51,616 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676282931615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282931615"}]},"ts":"1676282931615"} 2023-02-13 10:08:51,616 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282931615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282931615"}]},"ts":"1676282931615"} 2023-02-13 10:08:51,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 10:08:51,621 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:51,621 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282931621"}]},"ts":"1676282931621"} 2023-02-13 10:08:51,623 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-13 10:08:51,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec71b4d134f40901c4ce961630ab2813, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30df5af140d7623958af3d33dc87c931, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5f41dd240b983d854e23cd954e027448, ASSIGN}] 2023-02-13 10:08:51,733 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30df5af140d7623958af3d33dc87c931, ASSIGN 2023-02-13 10:08:51,733 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5f41dd240b983d854e23cd954e027448, ASSIGN 2023-02-13 10:08:51,733 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec71b4d134f40901c4ce961630ab2813, ASSIGN 2023-02-13 10:08:51,734 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec71b4d134f40901c4ce961630ab2813, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:51,734 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30df5af140d7623958af3d33dc87c931, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:51,734 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5f41dd240b983d854e23cd954e027448, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:51,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:51,887 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=30df5af140d7623958af3d33dc87c931, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:51,887 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ec71b4d134f40901c4ce961630ab2813, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:51,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5f41dd240b983d854e23cd954e027448, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:51,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676282931887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282931887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282931887"}]},"ts":"1676282931887"} 2023-02-13 10:08:51,888 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282931887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282931887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282931887"}]},"ts":"1676282931887"} 2023-02-13 10:08:51,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282931887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282931887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282931887"}]},"ts":"1676282931887"} 2023-02-13 10:08:51,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 30df5af140d7623958af3d33dc87c931, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:51,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure ec71b4d134f40901c4ce961630ab2813, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:51,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 5f41dd240b983d854e23cd954e027448, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:51,917 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/.tmp/family1/2e6bbd032d3d46e787f7efa90a4d7479 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/2e6bbd032d3d46e787f7efa90a4d7479 2023-02-13 10:08:51,923 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c7bad36d3e3feba9df3f34650d0420ca/family1 of c7bad36d3e3feba9df3f34650d0420ca into 2e6bbd032d3d46e787f7efa90a4d7479(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:08:51,924 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c7bad36d3e3feba9df3f34650d0420ca: 2023-02-13 10:08:51,924 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676282930660; duration=1sec 2023-02-13 10:08:51,924 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:51,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/a234c5cc198247fa9be14120bb151307, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_] to archive 2023-02-13 10:08:51,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:51,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/6b1b319ed8d24857b3fcbd2afd3535f1 2023-02-13 10:08:51,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/a234c5cc198247fa9be14120bb151307 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/a234c5cc198247fa9be14120bb151307 2023-02-13 10:08:51,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/family1/48261fec070e4ab79f2def0e554bea5a_SeqId_47_ 2023-02-13 10:08:52,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:52,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 30df5af140d7623958af3d33dc87c931, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 10:08:52,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:52,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,053 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,055 DEBUG [StoreOpener-30df5af140d7623958af3d33dc87c931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/family1 2023-02-13 10:08:52,055 DEBUG [StoreOpener-30df5af140d7623958af3d33dc87c931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/family1 2023-02-13 10:08:52,056 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30df5af140d7623958af3d33dc87c931 columnFamilyName family1 2023-02-13 10:08:52,058 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] regionserver.HStore(310): Store=30df5af140d7623958af3d33dc87c931/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,058 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,061 DEBUG [StoreOpener-30df5af140d7623958af3d33dc87c931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/family2 2023-02-13 10:08:52,061 DEBUG [StoreOpener-30df5af140d7623958af3d33dc87c931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/family2 2023-02-13 10:08:52,061 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30df5af140d7623958af3d33dc87c931 columnFamilyName family2 2023-02-13 10:08:52,064 INFO [StoreOpener-30df5af140d7623958af3d33dc87c931-1] regionserver.HStore(310): Store=30df5af140d7623958af3d33dc87c931/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:08:52,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 30df5af140d7623958af3d33dc87c931 2023-02-13 10:08:52,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:52,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 30df5af140d7623958af3d33dc87c931; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74963821, jitterRate=0.117047980427742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:08:52,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 30df5af140d7623958af3d33dc87c931: Running coprocessor pre-open hook at 1676282932051Writing region info on filesystem at 1676282932051Initializing all the Stores at 1676282932052 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932052Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932052Cleaning up temporary data from old regions at 1676282932068 (+16 ms)Cleaning up detritus from prior splits at 1676282932069 (+1 ms)Running coprocessor post-open hooks at 1676282932077 (+8 ms)Region opened successfully at 1676282932077 2023-02-13 10:08:52,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931., pid=31, masterSystemTime=1676282932046 2023-02-13 10:08:52,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:52,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:52,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:52,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f41dd240b983d854e23cd954e027448, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 10:08:52,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:52,082 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=30df5af140d7623958af3d33dc87c931, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:52,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,082 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676282932082"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282932082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282932082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282932082"}]},"ts":"1676282932082"} 2023-02-13 10:08:52,084 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,085 DEBUG [StoreOpener-5f41dd240b983d854e23cd954e027448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1 2023-02-13 10:08:52,086 DEBUG [StoreOpener-5f41dd240b983d854e23cd954e027448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1 2023-02-13 10:08:52,086 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f41dd240b983d854e23cd954e027448 columnFamilyName family1 2023-02-13 10:08:52,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-13 10:08:52,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 30df5af140d7623958af3d33dc87c931, server=jenkins-hbase16.apache.org,38311,1676282881622 in 192 msec 2023-02-13 10:08:52,087 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] regionserver.HStore(310): Store=5f41dd240b983d854e23cd954e027448/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,088 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30df5af140d7623958af3d33dc87c931, ASSIGN in 355 msec 2023-02-13 10:08:52,090 DEBUG [StoreOpener-5f41dd240b983d854e23cd954e027448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family2 2023-02-13 10:08:52,090 DEBUG [StoreOpener-5f41dd240b983d854e23cd954e027448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family2 2023-02-13 10:08:52,090 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f41dd240b983d854e23cd954e027448 columnFamilyName family2 2023-02-13 10:08:52,092 INFO [StoreOpener-5f41dd240b983d854e23cd954e027448-1] regionserver.HStore(310): Store=5f41dd240b983d854e23cd954e027448/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:08:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 5f41dd240b983d854e23cd954e027448 2023-02-13 10:08:52,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:52,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 5f41dd240b983d854e23cd954e027448; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61828169, jitterRate=-0.07868848741054535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:08:52,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 5f41dd240b983d854e23cd954e027448: Running coprocessor pre-open hook at 1676282932082Writing region info on filesystem at 1676282932082Initializing all the Stores at 1676282932083 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932083Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932084 (+1 ms)Cleaning up temporary data from old regions at 1676282932094 (+10 ms)Cleaning up detritus from prior splits at 1676282932095 (+1 ms)Running coprocessor post-open hooks at 1676282932099 (+4 ms)Region opened successfully at 1676282932099 2023-02-13 10:08:52,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448., pid=33, masterSystemTime=1676282932046 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:52,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:52,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec71b4d134f40901c4ce961630ab2813, NAME => 'testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 10:08:52,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5f41dd240b983d854e23cd954e027448, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:52,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282932101"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282932101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282932101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282932101"}]},"ts":"1676282932101"} 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,102 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,104 DEBUG [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/family1 2023-02-13 10:08:52,104 DEBUG [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/family1 2023-02-13 10:08:52,104 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec71b4d134f40901c4ce961630ab2813 columnFamilyName family1 2023-02-13 10:08:52,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-13 10:08:52,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 5f41dd240b983d854e23cd954e027448, server=jenkins-hbase16.apache.org,38311,1676282881622 in 208 msec 2023-02-13 10:08:52,105 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] regionserver.HStore(310): Store=ec71b4d134f40901c4ce961630ab2813/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,105 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5f41dd240b983d854e23cd954e027448, ASSIGN in 374 msec 2023-02-13 10:08:52,107 DEBUG [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/family2 2023-02-13 10:08:52,107 DEBUG [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/family2 2023-02-13 10:08:52,107 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec71b4d134f40901c4ce961630ab2813 columnFamilyName family2 2023-02-13 10:08:52,108 INFO [StoreOpener-ec71b4d134f40901c4ce961630ab2813-1] regionserver.HStore(310): Store=ec71b4d134f40901c4ce961630ab2813/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:52,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:08:52,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:08:52,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:52,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened ec71b4d134f40901c4ce961630ab2813; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67303354, jitterRate=0.0028981268405914307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:08:52,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for ec71b4d134f40901c4ce961630ab2813: Running coprocessor pre-open hook at 1676282932101Writing region info on filesystem at 1676282932101Initializing all the Stores at 1676282932102 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932102Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282932102Cleaning up temporary data from old regions at 1676282932109 (+7 ms)Cleaning up detritus from prior splits at 1676282932110 (+1 ms)Running coprocessor post-open hooks at 1676282932113 (+3 ms)Region opened successfully at 1676282932113 2023-02-13 10:08:52,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813., pid=32, masterSystemTime=1676282932046 2023-02-13 10:08:52,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:52,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:52,116 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ec71b4d134f40901c4ce961630ab2813, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:52,116 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676282932116"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282932116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282932116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282932116"}]},"ts":"1676282932116"} 2023-02-13 10:08:52,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-02-13 10:08:52,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure ec71b4d134f40901c4ce961630ab2813, server=jenkins-hbase16.apache.org,38311,1676282881622 in 223 msec 2023-02-13 10:08:52,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-13 10:08:52,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec71b4d134f40901c4ce961630ab2813, ASSIGN in 388 msec 2023-02-13 10:08:52,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:52,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282932122"}]},"ts":"1676282932122"} 2023-02-13 10:08:52,123 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-13 10:08:52,157 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:52,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.3870 sec 2023-02-13 10:08:52,507 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-13 10:08:52,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 10:08:52,884 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-13 10:08:52,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:52,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,902 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 10:08:52,902 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:52,903 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 10:08:52,903 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 10:08:52,904 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,904 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:52,939 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:52,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:52,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:52,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,941 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:52,942 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 10:08:52,942 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:52,942 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 10:08:52,942 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:52,942 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. started... 2023-02-13 10:08:52,942 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:08:52,942 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:52,943 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30df5af140d7623958af3d33dc87c931: 2023-02-13 10:08:52,943 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:52,942 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:52,943 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. started... 2023-02-13 10:08:52,943 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:08:52,942 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:52,944 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5f41dd240b983d854e23cd954e027448 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-13 10:08:52,944 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. started... 2023-02-13 10:08:52,945 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ec71b4d134f40901c4ce961630ab2813: 2023-02-13 10:08:52,945 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:52,945 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:08:53,368 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c87429ecdcd54046b82314fe75a2888f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213c87429ecdcd54046b82314fe75a2888f 2023-02-13 10:08:53,777 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp/family1/dc0c48812e484e79b8eb93ae5a54f7d0 2023-02-13 10:08:53,791 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp/family1/dc0c48812e484e79b8eb93ae5a54f7d0 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0 2023-02-13 10:08:53,800 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 10:08:53,801 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 5f41dd240b983d854e23cd954e027448 in 857ms, sequenceid=5, compaction requested=false 2023-02-13 10:08:53,801 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5f41dd240b983d854e23cd954e027448: 2023-02-13 10:08:53,801 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:53,801 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:08:53,802 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:08:53,802 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,802 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 10:08:53,802 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 10:08:53,831 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,831 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:53,832 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,832 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:53,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 10:08:53,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@156b206[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:53,836 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 10:08:53,836 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,847 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 10:08:53,847 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 10:08:53,847 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:53,847 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,848 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:53,856 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,856 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 10:08:53,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:53,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:53,856 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:53,856 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 10:08:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:53,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 10:08:53,862 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 10:08:53,862 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:53,862 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:53,862 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,862 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:53,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:53,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:53,874 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,877 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,905 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,905 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:53,906 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:53,906 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:53,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 10:08:53,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:53,906 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 10:08:53,906 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:53,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:53,907 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:54,008 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:54,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:54,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:54,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:54,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,024 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 10:08:54,024 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:54,025 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 10:08:54,025 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 10:08:54,026 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,026 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,039 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:54,039 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:54,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:54,041 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,041 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:54,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-13 10:08:54,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 10:08:54,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:54,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. started... 2023-02-13 10:08:54,045 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:08:54,045 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30df5af140d7623958af3d33dc87c931: 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:54,046 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. started... 2023-02-13 10:08:54,046 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:08:54,046 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ec71b4d134f40901c4ce961630ab2813: 2023-02-13 10:08:54,046 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:08:54,045 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. started... 2023-02-13 10:08:54,046 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:08:54,047 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5f41dd240b983d854e23cd954e027448 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-13 10:08:54,473 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021385b2afadc4294460b82e42d8b4cd0ad8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021385b2afadc4294460b82e42d8b4cd0ad8 2023-02-13 10:08:54,882 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp/family1/c9057b5317de4c5e9984faf09f1e989b 2023-02-13 10:08:54,896 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp/family1/c9057b5317de4c5e9984faf09f1e989b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b 2023-02-13 10:08:54,902 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b, entries=2, sequenceid=9, filesize=5.0 K 2023-02-13 10:08:54,903 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 5f41dd240b983d854e23cd954e027448 in 856ms, sequenceid=9, compaction requested=false 2023-02-13 10:08:54,903 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5f41dd240b983d854e23cd954e027448: 2023-02-13 10:08:54,903 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:54,903 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:08:54,903 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:08:54,903 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,903 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 10:08:54,903 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 10:08:54,931 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,931 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:54,932 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,932 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:54,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:54,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:54,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:54,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 10:08:54,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ae7803a[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:54,935 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 10:08:54,936 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 10:08:54,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 10:08:54,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:54,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:54,948 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 10:08:54,948 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:54,948 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 10:08:54,948 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:54,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 10:08:54,956 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 10:08:54,956 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:54,956 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:54,956 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,956 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:54,964 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,965 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:54,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,964 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:54,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:54,966 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:54,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,969 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:54,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 10:08:54,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:54,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 10:08:54,981 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:54,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,982 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:54,982 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:55,082 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:55,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:55,095 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-13 10:08:55,097 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 10:08:55,098 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 10:08:55,098 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:55,098 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283535098 2023-02-13 10:08:55,099 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:08:55,099 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-13 10:08:55,099 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 10:08:55,100 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x5de30b5a to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:08:55,107 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48d0fb41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:08:55,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 10:08:55,951 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137601c91851fc4a7db500e6328f8b176a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302137601c91851fc4a7db500e6328f8b176a 2023-02-13 10:08:55,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 10:08:55,967 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:08:55,969 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58776, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:08:55,975 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:08:55,977 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:48798, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:08:55,987 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a63231af10cc4176a35a3a32bbd91778 first=Optional[k0] last=Optional[k1] 2023-02-13 10:08:55,988 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a63231af10cc4176a35a3a32bbd91778}] 2023-02-13 10:08:55,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a63231af10cc4176a35a3a32bbd91778 for inclusion in 5f41dd240b983d854e23cd954e027448/family1 2023-02-13 10:08:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-13 10:08:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 10:08:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 5f41dd240b983d854e23cd954e027448: 2023-02-13 10:08:55,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a63231af10cc4176a35a3a32bbd91778 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__or3sncibkfttbuqogu2ma7rck6kc5so0kkkd7c40ei49ap8no64a4u6knpjiu4ub/family1/a63231af10cc4176a35a3a32bbd91778 2023-02-13 10:08:56,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__or3sncibkfttbuqogu2ma7rck6kc5so0kkkd7c40ei49ap8no64a4u6knpjiu4ub/family1/a63231af10cc4176a35a3a32bbd91778 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_ 2023-02-13 10:08:56,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__or3sncibkfttbuqogu2ma7rck6kc5so0kkkd7c40ei49ap8no64a4u6knpjiu4ub/family1/a63231af10cc4176a35a3a32bbd91778 into 5f41dd240b983d854e23cd954e027448/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_ - updating store file list. 2023-02-13 10:08:56,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_ into 5f41dd240b983d854e23cd954e027448/family1 2023-02-13 10:08:56,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__or3sncibkfttbuqogu2ma7rck6kc5so0kkkd7c40ei49ap8no64a4u6knpjiu4ub/family1/a63231af10cc4176a35a3a32bbd91778 into 5f41dd240b983d854e23cd954e027448/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_) 2023-02-13 10:08:56,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__or3sncibkfttbuqogu2ma7rck6kc5so0kkkd7c40ei49ap8no64a4u6knpjiu4ub/family1/a63231af10cc4176a35a3a32bbd91778 2023-02-13 10:08:56,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:08:56,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:08:56,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): 5f41dd240b983d854e23cd954e027448/family1 is initiating minor compaction (all files) 2023-02-13 10:08:56,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6bffaa7c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:56,011 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5f41dd240b983d854e23cd954e027448/family1 in testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:08:56,012 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp, totalSize=15.1 K 2023-02-13 10:08:56,012 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting dc0c48812e484e79b8eb93ae5a54f7d0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282932884 2023-02-13 10:08:56,013 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting c9057b5317de4c5e9984faf09f1e989b, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282932884 2023-02-13 10:08:56,013 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting de84ceec06954195a5c8aedecd254c61_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282932884 2023-02-13 10:08:56,014 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 10:08:56,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:56,016 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021385b2afadc4294460b82e42d8b4cd0ad8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021385b2afadc4294460b82e42d8b4cd0ad8 2023-02-13 10:08:56,018 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213c87429ecdcd54046b82314fe75a2888f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213c87429ecdcd54046b82314fe75a2888f 2023-02-13 10:08:56,018 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-13 10:08:56,018 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 10:08:56,018 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 10:08:56,019 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 10:08:56,019 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:08:56,020 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 10:08:56,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 924 msec 2023-02-13 10:08:56,025 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5f41dd240b983d854e23cd954e027448#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:08:56,056 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=246 (was 251), OpenFileDescriptor=593 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 168), ProcessCount=165 (was 166), AvailableMemoryMB=7895 (was 7896) 2023-02-13 10:08:56,066 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=246, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=165, AvailableMemoryMB=7895 2023-02-13 10:08:56,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:08:56,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:56,071 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:08:56,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-13 10:08:56,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:08:56,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 10:08:56,073 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,074 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b empty. 2023-02-13 10:08:56,074 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-13 10:08:56,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 10:08:56,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 10:08:56,485 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 10:08:56,488 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => f822e7441393470eb937d55672c0347b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:08:56,498 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:56,498 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing f822e7441393470eb937d55672c0347b, disabling compactions & flushes 2023-02-13 10:08:56,498 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,499 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,499 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. after waiting 0 ms 2023-02-13 10:08:56,499 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,499 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,499 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for f822e7441393470eb937d55672c0347b: Waiting for close lock at 1676282936498Disabling compacts and flushes for region at 1676282936498Disabling writes for close at 1676282936499 (+1 ms)Writing region close event to WAL at 1676282936499Closed at 1676282936499 2023-02-13 10:08:56,503 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:08:56,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282936504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282936504"}]},"ts":"1676282936504"} 2023-02-13 10:08:56,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:08:56,507 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:08:56,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282936507"}]},"ts":"1676282936507"} 2023-02-13 10:08:56,508 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 10:08:56,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f822e7441393470eb937d55672c0347b, ASSIGN}] 2023-02-13 10:08:56,551 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f822e7441393470eb937d55672c0347b, ASSIGN 2023-02-13 10:08:56,553 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f822e7441393470eb937d55672c0347b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:08:56,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 10:08:56,705 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f822e7441393470eb937d55672c0347b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:56,705 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282936705"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282936705"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282936705"}]},"ts":"1676282936705"} 2023-02-13 10:08:56,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f822e7441393470eb937d55672c0347b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:08:56,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f822e7441393470eb937d55672c0347b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:08:56,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:08:56,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,872 INFO [StoreOpener-f822e7441393470eb937d55672c0347b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,874 DEBUG [StoreOpener-f822e7441393470eb937d55672c0347b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:08:56,875 DEBUG [StoreOpener-f822e7441393470eb937d55672c0347b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:08:56,876 INFO [StoreOpener-f822e7441393470eb937d55672c0347b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f822e7441393470eb937d55672c0347b columnFamilyName family1 2023-02-13 10:08:56,878 INFO [StoreOpener-f822e7441393470eb937d55672c0347b-1] regionserver.HStore(310): Store=f822e7441393470eb937d55672c0347b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:08:56,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for f822e7441393470eb937d55672c0347b 2023-02-13 10:08:56,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:08:56,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened f822e7441393470eb937d55672c0347b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62619195, jitterRate=-0.06690128147602081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:08:56,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for f822e7441393470eb937d55672c0347b: Running coprocessor pre-open hook at 1676282936869Writing region info on filesystem at 1676282936869Initializing all the Stores at 1676282936871 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282936871Cleaning up temporary data from old regions at 1676282936882 (+11 ms)Cleaning up detritus from prior splits at 1676282936882Running coprocessor post-open hooks at 1676282936886 (+4 ms)Region opened successfully at 1676282936886 2023-02-13 10:08:56,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b., pid=37, masterSystemTime=1676282936863 2023-02-13 10:08:56,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:56,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f822e7441393470eb937d55672c0347b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:56,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676282936889"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282936889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282936889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282936889"}]},"ts":"1676282936889"} 2023-02-13 10:08:56,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-13 10:08:56,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f822e7441393470eb937d55672c0347b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 182 msec 2023-02-13 10:08:56,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-13 10:08:56,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f822e7441393470eb937d55672c0347b, ASSIGN in 344 msec 2023-02-13 10:08:56,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:08:56,894 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282936894"}]},"ts":"1676282936894"} 2023-02-13 10:08:56,895 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 10:08:56,940 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:08:56,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 871 msec 2023-02-13 10:08:57,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 10:08:57,182 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-13 10:08:57,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:57,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,213 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:57,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:57,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:57,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:57,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:57,222 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:57,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:57,223 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:57,223 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:57,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:57,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:57,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:57,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:57,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:57,224 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:57,225 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:08:57,225 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:08:57,255 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/.tmp/family1/1ea4a22bb89b4ba6a6a2e38381709a01 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/1ea4a22bb89b4ba6a6a2e38381709a01 2023-02-13 10:08:57,260 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5f41dd240b983d854e23cd954e027448/family1 of 5f41dd240b983d854e23cd954e027448 into 1ea4a22bb89b4ba6a6a2e38381709a01(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:08:57,260 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5f41dd240b983d854e23cd954e027448: 2023-02-13 10:08:57,260 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676282936011; duration=1sec 2023-02-13 10:08:57,261 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:08:57,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_] to archive 2023-02-13 10:08:57,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:08:57,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/dc0c48812e484e79b8eb93ae5a54f7d0 2023-02-13 10:08:57,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/c9057b5317de4c5e9984faf09f1e989b 2023-02-13 10:08:57,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/family1/de84ceec06954195a5c8aedecd254c61_SeqId_12_ 2023-02-13 10:08:57,579 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:08:57,646 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307564ad0cef5d426c891d600dfdfa0736 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307564ad0cef5d426c891d600dfdfa0736 2023-02-13 10:08:58,052 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/c67d7a5702f744bfbaadfcfc34e94c42 2023-02-13 10:08:58,064 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/c67d7a5702f744bfbaadfcfc34e94c42 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42 2023-02-13 10:08:58,070 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 10:08:58,071 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 846ms, sequenceid=5, compaction requested=false 2023-02-13 10:08:58,071 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:58,071 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:08:58,072 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:58,072 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:58,072 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:58,072 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,072 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:58,072 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:58,114 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,114 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:58,115 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,115 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:58,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:58,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@546f3395[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:58,119 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:58,119 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,130 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,130 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:58,131 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:58,131 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:58,131 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,131 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:58,139 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:58,139 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:58,139 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,140 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:58,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:58,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:58,149 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:58,149 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:58,149 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:58,149 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,149 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:58,156 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,156 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:58,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,156 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:58,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:58,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:58,157 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,158 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,165 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:58,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:58,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:58,164 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:58,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:08:58,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:58,165 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:58,166 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:58,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:58,266 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:58,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:58,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:58,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:58,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,281 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:58,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:58,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:58,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:58,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,289 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:58,289 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:58,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:58,290 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:58,290 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,291 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:58,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:58,291 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:58,291 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:58,291 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:58,291 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:58,291 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:58,291 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:58,291 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:08:58,291 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:08:58,713 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283b7cf6817f9e4383a6f1250a45a9bbdc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511283b7cf6817f9e4383a6f1250a45a9bbdc 2023-02-13 10:08:59,123 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/a5a1b839100d4f5289b36c9469ea668d 2023-02-13 10:08:59,140 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/a5a1b839100d4f5289b36c9469ea668d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d 2023-02-13 10:08:59,148 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:08:59,149 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 858ms, sequenceid=9, compaction requested=false 2023-02-13 10:08:59,149 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:08:59,149 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:59,150 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:08:59,150 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:08:59,150 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,150 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:08:59,150 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:08:59,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,164 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:59,165 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,165 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:08:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:59,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:08:59,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cb5408b[Count = 0] remaining members to acquire global barrier 2023-02-13 10:08:59,169 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:08:59,169 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,198 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,199 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:08:59,199 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:08:59,199 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:08:59,199 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,199 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:08:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:08:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:08:59,214 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:08:59,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:08:59,217 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:08:59,217 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:08:59,217 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:08:59,217 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,217 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:08:59,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:59,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:08:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:08:59,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:08:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,223 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:08:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,224 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:08:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:08:59,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:59,231 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:59,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:08:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:08:59,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:08:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,231 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:08:59,232 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,332 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:08:59,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:08:59,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:08:59,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:08:59,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,348 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:08:59,348 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:59,348 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:08:59,348 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:08:59,349 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,349 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,356 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:08:59,356 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:08:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:08:59,356 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:08:59,356 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:08:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:08:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,357 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,358 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:08:59,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:08:59,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:08:59,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:08:59,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:08:59,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:08:59,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:08:59,358 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:08:59,358 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:08:59,358 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:08:59,785 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a47d3ad62bbc4214be8a5c53208fbb7f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a47d3ad62bbc4214be8a5c53208fbb7f 2023-02-13 10:09:00,194 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/6afd3aafc7ef48f0a07577c50ba13ea5 2023-02-13 10:09:00,204 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/6afd3aafc7ef48f0a07577c50ba13ea5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5 2023-02-13 10:09:00,211 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 10:09:00,212 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 854ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:00,212 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:00,213 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:00,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:00,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:00,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:00,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:00,239 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,239 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:00,240 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,240 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:00,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:00,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:00,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:00,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:00,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68c70f99[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:00,245 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:00,245 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,256 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:00,256 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,256 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:00,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:00,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:00,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:00,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:00,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:00,264 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:00,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:00,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:00,267 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:00,267 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:00,267 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:00,267 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,267 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:00,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:00,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,273 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:00,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:00,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:00,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:00,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:00,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:00,282 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:00,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,282 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:00,282 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,382 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:00,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:00,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:00,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:00,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,396 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:00,396 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:00,397 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:00,397 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:00,397 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,397 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,406 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:00,406 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:00,406 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:00,407 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:00,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:00,409 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:00,409 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:00,409 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:00,410 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:00,410 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:00,410 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:00,410 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:00,410 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:00,834 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205682c4af72e51401aa5aea9f240caa483 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205682c4af72e51401aa5aea9f240caa483 2023-02-13 10:09:01,242 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/76fe8395745945c39be423cbd4d93676 2023-02-13 10:09:01,254 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/76fe8395745945c39be423cbd4d93676 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676 2023-02-13 10:09:01,261 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 10:09:01,262 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 852ms, sequenceid=17, compaction requested=true 2023-02-13 10:09:01,262 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:01,262 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:01,262 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:01,262 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:01,262 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,262 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:01,263 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:01,289 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,289 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:01,290 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:01,290 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:01,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:01,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e67a4eb[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:01,293 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:01,293 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,297 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,298 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:01,298 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:01,298 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:01,298 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,298 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:01,306 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:01,306 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:01,306 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:01,306 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:01,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:01,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:01,313 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:01,313 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:01,313 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:01,313 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,313 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:01,322 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,322 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:01,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,323 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:01,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:01,324 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:01,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,327 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,339 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:01,339 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:01,339 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:01,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:01,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:01,339 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:01,339 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,340 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,340 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:01,341 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:01,341 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:01,341 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,341 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,341 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,441 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:01,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:01,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:01,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:01,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,451 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:01,451 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:01,451 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:01,451 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:01,452 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,452 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,482 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:01,482 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:01,483 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,484 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:01,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,487 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:01,487 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:01,487 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:01,488 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:01,488 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:01,488 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:01,488 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:01,488 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:01,914 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288f3fa0ae016e4aeebec7fcbafd76cb35 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288f3fa0ae016e4aeebec7fcbafd76cb35 2023-02-13 10:09:01,921 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/39631d348ea24f59a57774fe2421a18a 2023-02-13 10:09:01,928 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/39631d348ea24f59a57774fe2421a18a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a 2023-02-13 10:09:01,934 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 10:09:01,935 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 447ms, sequenceid=21, compaction requested=true 2023-02-13 10:09:01,935 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:01,935 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:01,935 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:01,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:01,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:01,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:01,964 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,964 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:01,965 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,965 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:01,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:01,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:01,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:01,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339d929[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:01,970 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:01,970 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,981 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,981 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:01,981 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:01,981 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:01,982 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,982 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:01,989 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,989 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:01,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:01,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:01,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:01,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:01,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:01,999 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:01,999 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:01,999 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:01,999 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:01,999 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:02,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,006 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:02,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:02,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:02,006 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,007 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,014 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:02,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:02,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:02,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:02,015 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:02,015 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:02,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:02,014 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,015 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,015 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,015 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,115 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:02,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:02,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:02,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:02,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,129 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:02,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:02,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:02,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:02,131 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,131 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,139 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,139 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:02,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:02,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:02,140 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:02,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:02,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:02,144 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:02,144 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:02,144 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:02,144 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:02,145 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:02,145 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:02,145 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:02,145 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:02,570 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a42d7fa66a2d437692f2b03d5b469491 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a42d7fa66a2d437692f2b03d5b469491 2023-02-13 10:09:02,978 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/2b437eab5b2c4c34ad6ec28d7a44293c 2023-02-13 10:09:02,992 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/2b437eab5b2c4c34ad6ec28d7a44293c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c 2023-02-13 10:09:02,999 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 10:09:03,000 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 855ms, sequenceid=25, compaction requested=true 2023-02-13 10:09:03,000 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:03,000 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:03,000 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:03,000 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:03,000 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,001 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:03,001 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:03,031 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,031 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:03,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,032 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:03,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:03,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@757e70dd[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:03,036 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:03,036 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,047 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,048 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:03,048 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:03,048 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:03,048 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,048 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:03,056 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:03,056 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,056 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:03,056 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:03,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:03,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:03,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:03,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:03,065 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:03,065 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:03,065 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:03,065 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,065 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:03,072 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,072 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:03,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,073 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:03,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:03,074 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:03,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:03,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,077 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:03,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,089 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:03,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:03,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:03,090 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:03,090 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,090 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:03,090 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,190 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:03,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:03,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,202 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:03,202 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:03,202 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:03,202 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:03,203 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,203 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,213 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,214 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:03,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:03,214 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:03,216 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:03,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,219 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:03,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:03,219 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:03,220 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:03,220 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:03,220 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:03,220 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:03,220 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:03,220 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:03,221 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:03,648 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101225d9878a5d54daab5becd6a84ca3a18 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101225d9878a5d54daab5becd6a84ca3a18 2023-02-13 10:09:04,057 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/3bd4cd3740354b62899a7c2a27b419fb 2023-02-13 10:09:04,070 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/3bd4cd3740354b62899a7c2a27b419fb as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb 2023-02-13 10:09:04,077 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 10:09:04,078 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 857ms, sequenceid=29, compaction requested=true 2023-02-13 10:09:04,078 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:04,078 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:04,078 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:04,078 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:04,078 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,078 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:04,078 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:04,089 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,089 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:04,089 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,089 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:04,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:04,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:04,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2515122c[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:04,091 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,097 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,097 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:04,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:04,098 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,098 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:04,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:04,105 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:04,105 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,105 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,106 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:04,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:04,108 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:04,108 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:04,108 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:04,108 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,108 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:04,114 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,114 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:04,114 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,114 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:04,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:04,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:04,115 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:04,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:04,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:04,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,142 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,141 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:04,142 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:04,142 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:04,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:04,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:04,141 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:04,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:04,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:04,242 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:04,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:04,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:04,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:04,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,259 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:04,259 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:04,259 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:04,259 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:04,260 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,260 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:04,272 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:04,273 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:04,273 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:04,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:04,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:04,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:04,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:04,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:04,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:04,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:04,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:04,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:04,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:04,274 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:04,695 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103df4c49ad733f4c1d89c5957d241cdd15 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103df4c49ad733f4c1d89c5957d241cdd15 2023-02-13 10:09:05,103 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/383689322dd045078e722da10a8342a5 2023-02-13 10:09:05,118 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/383689322dd045078e722da10a8342a5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5 2023-02-13 10:09:05,123 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 10:09:05,125 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 851ms, sequenceid=33, compaction requested=true 2023-02-13 10:09:05,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:05,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:05,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:05,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:05,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:05,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:05,130 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,130 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:05,131 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,131 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36c6aa99[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:05,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:05,132 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,139 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,139 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:05,139 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:05,139 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:05,139 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,139 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:05,147 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:05,147 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:05,147 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,147 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:05,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:05,150 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:05,150 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:05,150 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:05,150 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,150 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:05,155 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,155 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:05,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,155 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:05,156 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,157 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,164 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:05,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:05,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:05,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:05,165 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:05,165 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:05,165 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,165 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:05,265 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:05,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:05,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:05,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:05,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,275 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:05,276 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:05,276 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:05,276 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:05,276 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,276 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,281 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:05,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:05,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:05,281 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,282 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,283 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:05,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:05,284 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:05,284 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:05,284 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:05,284 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:05,284 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:05,284 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:05,284 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:05,284 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:05,705 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075db44751ee554c61a2039fd7fb9c800a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509075db44751ee554c61a2039fd7fb9c800a 2023-02-13 10:09:06,113 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/330b4062249c4612ba09076c07cc2cd3 2023-02-13 10:09:06,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/330b4062249c4612ba09076c07cc2cd3 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3 2023-02-13 10:09:06,131 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 10:09:06,132 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 848ms, sequenceid=37, compaction requested=true 2023-02-13 10:09:06,132 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:06,132 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:06,132 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:06,132 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:06,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:06,133 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:06,164 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,164 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:06,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:06,165 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,165 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:06,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:06,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:06,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:06,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bfbddf9[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:06,169 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:06,170 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,181 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,181 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:06,181 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:06,181 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:06,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,182 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:06,189 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:06,189 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,189 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:06,189 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:06,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:06,200 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:06,200 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:06,200 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:06,200 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,200 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:06,206 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,206 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:06,206 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:06,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:06,207 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:06,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,211 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,223 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,223 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 10:09:06,222 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:06,223 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:06,223 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:06,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:06,223 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:06,223 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:06,224 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:06,224 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:06,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:06,324 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:06,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,339 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:06,339 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:06,339 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 10:09:06,339 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 10:09:06,340 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,340 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,347 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,347 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:06,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:06,348 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:06,348 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 10:09:06,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:06,350 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 10:09:06,350 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:06,351 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 10:09:06,351 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:06,351 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:06,351 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:06,351 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. started... 2023-02-13 10:09:06,351 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f822e7441393470eb937d55672c0347b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:06,779 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120dd665bab195949c3b8dd83499c4c6863 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120dd665bab195949c3b8dd83499c4c6863 2023-02-13 10:09:07,187 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/819d18e92fba4be095a2dfae0e4c418f 2023-02-13 10:09:07,200 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/819d18e92fba4be095a2dfae0e4c418f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f 2023-02-13 10:09:07,207 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 10:09:07,208 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f822e7441393470eb937d55672c0347b in 856ms, sequenceid=41, compaction requested=true 2023-02-13 10:09:07,208 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:07,208 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:07,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:07,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:07,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 10:09:07,208 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 10:09:07,239 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,239 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:07,239 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,240 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:07,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:07,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:07,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:07,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 10:09:07,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d05b2c3[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:07,243 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 10:09:07,243 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,247 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,247 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 10:09:07,248 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 10:09:07,248 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:07,248 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,248 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:07,256 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 10:09:07,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:07,256 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 10:09:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:07,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:07,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:09:07,264 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 10:09:07,264 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:07,264 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:07,264 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,264 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:07,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:07,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:07,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:07,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:07,274 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,277 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,310 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:07,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 10:09:07,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:07,310 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:07,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:07,411 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:07,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:07,415 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-13 10:09:07,420 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:09:07,421 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:09:07,423 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:07,423 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283547423 2023-02-13 10:09:07,424 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:07,425 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 10:09:07,425 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:07,426 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x73e0a974 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:07,439 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ca54eba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:07,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,276 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103de50493319c64ef3a6817f67586eee62 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103de50493319c64ef3a6817f67586eee62 2023-02-13 10:09:08,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:08,291 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:08,292 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:08,299 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:08,300 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:39720, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:08,309 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c20ea631161142d7bed137c62acc5d68 first=Optional[r3] last=Optional[r6] 2023-02-13 10:09:08,310 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c20ea631161142d7bed137c62acc5d68}] 2023-02-13 10:09:08,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c20ea631161142d7bed137c62acc5d68 for inclusion in f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:09:08,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 10:09:08,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:08,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:08,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c20ea631161142d7bed137c62acc5d68 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b4e01tib5gh0tk96sn58eqmf8v93jgvmnckjuoo0cc49j5c9hgfbed4il4crqhi2/family1/c20ea631161142d7bed137c62acc5d68 2023-02-13 10:09:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b4e01tib5gh0tk96sn58eqmf8v93jgvmnckjuoo0cc49j5c9hgfbed4il4crqhi2/family1/c20ea631161142d7bed137c62acc5d68 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_ 2023-02-13 10:09:08,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b4e01tib5gh0tk96sn58eqmf8v93jgvmnckjuoo0cc49j5c9hgfbed4il4crqhi2/family1/c20ea631161142d7bed137c62acc5d68 into f822e7441393470eb937d55672c0347b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_ - updating store file list. 2023-02-13 10:09:08,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_ into f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:09:08,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b4e01tib5gh0tk96sn58eqmf8v93jgvmnckjuoo0cc49j5c9hgfbed4il4crqhi2/family1/c20ea631161142d7bed137c62acc5d68 into f822e7441393470eb937d55672c0347b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_) 2023-02-13 10:09:08,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b4e01tib5gh0tk96sn58eqmf8v93jgvmnckjuoo0cc49j5c9hgfbed4il4crqhi2/family1/c20ea631161142d7bed137c62acc5d68 2023-02-13 10:09:08,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:09:08,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:09:08,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): f822e7441393470eb937d55672c0347b/family1 is initiating minor compaction 2023-02-13 10:09:08,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@77d06036; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:08,335 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f822e7441393470eb937d55672c0347b/family1 in testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:08,336 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp, totalSize=50.0 K 2023-02-13 10:09:08,336 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting a5a1b839100d4f5289b36c9469ea668d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:09:08,336 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 6afd3aafc7ef48f0a07577c50ba13ea5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:09:08,336 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 76fe8395745945c39be423cbd4d93676, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:09:08,336 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 39631d348ea24f59a57774fe2421a18a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:09:08,336 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 2b437eab5b2c4c34ad6ec28d7a44293c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:09:08,337 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 3bd4cd3740354b62899a7c2a27b419fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:09:08,337 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 383689322dd045078e722da10a8342a5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:09:08,337 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 330b4062249c4612ba09076c07cc2cd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:09:08,337 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 819d18e92fba4be095a2dfae0e4c418f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:09:08,337 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:09:08,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:08,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:08,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288f3fa0ae016e4aeebec7fcbafd76cb35 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288f3fa0ae016e4aeebec7fcbafd76cb35 2023-02-13 10:09:08,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a42d7fa66a2d437692f2b03d5b469491 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a42d7fa66a2d437692f2b03d5b469491 2023-02-13 10:09:08,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101225d9878a5d54daab5becd6a84ca3a18 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101225d9878a5d54daab5becd6a84ca3a18 2023-02-13 10:09:08,347 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103df4c49ad733f4c1d89c5957d241cdd15 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103df4c49ad733f4c1d89c5957d241cdd15 2023-02-13 10:09:08,347 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 10:09:08,347 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 10:09:08,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:08,370 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): f822e7441393470eb937d55672c0347b#family1#compaction#49 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:08,388 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/f7360ecaf1c2447caaad926d2919a20b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/f7360ecaf1c2447caaad926d2919a20b 2023-02-13 10:09:08,393 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f822e7441393470eb937d55672c0347b/family1 of f822e7441393470eb937d55672c0347b into f7360ecaf1c2447caaad926d2919a20b(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:09:08,393 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:08,393 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676282948335; duration=0sec 2023-02-13 10:09:08,393 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:08,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_] to archive 2023-02-13 10:09:08,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:08,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/a5a1b839100d4f5289b36c9469ea668d 2023-02-13 10:09:08,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/6afd3aafc7ef48f0a07577c50ba13ea5 2023-02-13 10:09:08,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/76fe8395745945c39be423cbd4d93676 2023-02-13 10:09:08,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/39631d348ea24f59a57774fe2421a18a 2023-02-13 10:09:08,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/2b437eab5b2c4c34ad6ec28d7a44293c 2023-02-13 10:09:08,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/3bd4cd3740354b62899a7c2a27b419fb 2023-02-13 10:09:08,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/383689322dd045078e722da10a8342a5 2023-02-13 10:09:08,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/330b4062249c4612ba09076c07cc2cd3 2023-02-13 10:09:08,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/819d18e92fba4be095a2dfae0e4c418f 2023-02-13 10:09:08,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/79e1521d267a4a6dbc8c5806c78a3512_SeqId_44_ 2023-02-13 10:09:09,207 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dadadbe082e54c858ea2c957143c89b3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205dadadbe082e54c858ea2c957143c89b3 2023-02-13 10:09:09,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:09,232 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f69126405cb48f1a05a8087a6276e92 first=Optional[r00] last=Optional[r2] 2023-02-13 10:09:09,233 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f69126405cb48f1a05a8087a6276e92}] 2023-02-13 10:09:09,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f69126405cb48f1a05a8087a6276e92 for inclusion in f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:09:09,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 10:09:09,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f69126405cb48f1a05a8087a6276e92 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__atbmjn4h2r6mjk4fumakvsv9c87lpchhjp5opb06pdqiijmbf222hm4tf5p0thoi/family1/1f69126405cb48f1a05a8087a6276e92 2023-02-13 10:09:09,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__atbmjn4h2r6mjk4fumakvsv9c87lpchhjp5opb06pdqiijmbf222hm4tf5p0thoi/family1/1f69126405cb48f1a05a8087a6276e92 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_ 2023-02-13 10:09:09,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__atbmjn4h2r6mjk4fumakvsv9c87lpchhjp5opb06pdqiijmbf222hm4tf5p0thoi/family1/1f69126405cb48f1a05a8087a6276e92 into f822e7441393470eb937d55672c0347b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_ - updating store file list. 2023-02-13 10:09:09,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_ into f822e7441393470eb937d55672c0347b/family1 2023-02-13 10:09:09,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__atbmjn4h2r6mjk4fumakvsv9c87lpchhjp5opb06pdqiijmbf222hm4tf5p0thoi/family1/1f69126405cb48f1a05a8087a6276e92 into f822e7441393470eb937d55672c0347b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_) 2023-02-13 10:09:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__atbmjn4h2r6mjk4fumakvsv9c87lpchhjp5opb06pdqiijmbf222hm4tf5p0thoi/family1/1f69126405cb48f1a05a8087a6276e92 2023-02-13 10:09:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:09:09,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:09:09,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): f822e7441393470eb937d55672c0347b/family1 is initiating minor compaction (all files) 2023-02-13 10:09:09,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bea4aed; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 10:09:09,249 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2258): Starting compaction of f822e7441393470eb937d55672c0347b/family1 in testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:09:09,249 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/f7360ecaf1c2447caaad926d2919a20b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp, totalSize=337.0 K 2023-02-13 10:09:09,250 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting c67d7a5702f744bfbaadfcfc34e94c42, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:09:09,250 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting f7360ecaf1c2447caaad926d2919a20b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:09:09,250 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting cb1646b97241484790e26706596642e9_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806172 2023-02-13 10:09:09,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:09,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:09,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307564ad0cef5d426c891d600dfdfa0736 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307564ad0cef5d426c891d600dfdfa0736 2023-02-13 10:09:09,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a47d3ad62bbc4214be8a5c53208fbb7f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a47d3ad62bbc4214be8a5c53208fbb7f 2023-02-13 10:09:09,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205682c4af72e51401aa5aea9f240caa483 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205682c4af72e51401aa5aea9f240caa483 2023-02-13 10:09:09,255 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-13 10:09:09,255 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 10:09:09,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 10:09:09,255 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 10:09:09,255 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:09,256 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:09:09,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8380 sec 2023-02-13 10:09:09,265 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] throttle.PressureAwareThroughputController(145): f822e7441393470eb937d55672c0347b#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:09,344 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=250 (was 246) - Thread LEAK? -, OpenFileDescriptor=611 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 154) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=7880 (was 7895) 2023-02-13 10:09:09,352 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=165, AvailableMemoryMB=7880 2023-02-13 10:09:09,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:09:09,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:09,356 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:09:09,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-13 10:09:09,357 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:09:09,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:09,358 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:09,359 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 empty. 2023-02-13 10:09:09,359 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:09,359 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-13 10:09:09,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:09,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:09,768 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:09,772 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => feb7074ad7e4dc5391d9000c2a69a333, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:09,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:10,183 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:10,183 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing feb7074ad7e4dc5391d9000c2a69a333, disabling compactions & flushes 2023-02-13 10:09:10,183 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,183 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,183 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. after waiting 0 ms 2023-02-13 10:09:10,183 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,183 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,184 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for feb7074ad7e4dc5391d9000c2a69a333: Waiting for close lock at 1676282950183Disabling compacts and flushes for region at 1676282950183Disabling writes for close at 1676282950183Writing region close event to WAL at 1676282950183Closed at 1676282950183 2023-02-13 10:09:10,189 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:09:10,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282950192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282950192"}]},"ts":"1676282950192"} 2023-02-13 10:09:10,194 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:09:10,195 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:09:10,195 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282950195"}]},"ts":"1676282950195"} 2023-02-13 10:09:10,197 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-13 10:09:10,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, ASSIGN}] 2023-02-13 10:09:10,242 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, ASSIGN 2023-02-13 10:09:10,243 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:10,395 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:10,396 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282950395"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282950395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282950395"}]},"ts":"1676282950395"} 2023-02-13 10:09:10,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:10,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:10,499 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/.tmp/family1/d53a9becfc9c4f3d9513349b26178cf7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/d53a9becfc9c4f3d9513349b26178cf7 2023-02-13 10:09:10,506 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f822e7441393470eb937d55672c0347b/family1 of f822e7441393470eb937d55672c0347b into d53a9becfc9c4f3d9513349b26178cf7(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:09:10,506 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for f822e7441393470eb937d55672c0347b: 2023-02-13 10:09:10,507 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676282949249; duration=1sec 2023-02-13 10:09:10,507 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:10,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => feb7074ad7e4dc5391d9000c2a69a333, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,558 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,559 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:10,559 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:10,560 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7074ad7e4dc5391d9000c2a69a333 columnFamilyName family1 2023-02-13 10:09:10,561 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(310): Store=feb7074ad7e4dc5391d9000c2a69a333/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:10,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:10,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:10,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened feb7074ad7e4dc5391d9000c2a69a333; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72155298, jitterRate=0.0751977264881134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:10,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for feb7074ad7e4dc5391d9000c2a69a333: Running coprocessor pre-open hook at 1676282950556Writing region info on filesystem at 1676282950556Initializing all the Stores at 1676282950557 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282950557Cleaning up temporary data from old regions at 1676282950563 (+6 ms)Cleaning up detritus from prior splits at 1676282950563Running coprocessor post-open hooks at 1676282950568 (+5 ms)Region opened successfully at 1676282950568 2023-02-13 10:09:10,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., pid=41, masterSystemTime=1676282950553 2023-02-13 10:09:10,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:10,572 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:10,572 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282950572"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282950572"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282950572"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282950572"}]},"ts":"1676282950572"} 2023-02-13 10:09:10,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-13 10:09:10,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622 in 175 msec 2023-02-13 10:09:10,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-13 10:09:10,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, ASSIGN in 337 msec 2023-02-13 10:09:10,578 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:09:10,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282950578"}]},"ts":"1676282950578"} 2023-02-13 10:09:10,579 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-13 10:09:10,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/f7360ecaf1c2447caaad926d2919a20b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_] to archive 2023-02-13 10:09:10,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:10,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/c67d7a5702f744bfbaadfcfc34e94c42 2023-02-13 10:09:10,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/f7360ecaf1c2447caaad926d2919a20b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/f7360ecaf1c2447caaad926d2919a20b 2023-02-13 10:09:10,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/family1/cb1646b97241484790e26706596642e9_SeqId_47_ 2023-02-13 10:09:10,607 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:09:10,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2530 sec 2023-02-13 10:09:11,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 10:09:11,466 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-13 10:09:11,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:11,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,498 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:11,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:11,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:11,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:11,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:11,530 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:11,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:11,531 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:11,531 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:11,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:11,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:11,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:11,532 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:11,533 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:11,533 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:11,533 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:11,533 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:09:11,955 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130520f883743d342d28dbf4e1c62219f7c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130520f883743d342d28dbf4e1c62219f7c 2023-02-13 10:09:12,362 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c 2023-02-13 10:09:12,380 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c 2023-02-13 10:09:12,387 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-13 10:09:12,388 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 855ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:12,388 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:12,389 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:12,389 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:12,389 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:12,389 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:12,389 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:12,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:12,414 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:12,415 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,415 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:12,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:12,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:12,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@700c4b3d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:12,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:12,419 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,430 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,430 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:12,430 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:12,430 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:12,431 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,431 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:12,438 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,439 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:12,439 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:12,439 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:12,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:12,441 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:12,441 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:12,441 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:12,441 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,441 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:12,447 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,447 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:12,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,447 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:12,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:12,448 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,455 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,455 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:12,455 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:12,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:12,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:12,455 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:12,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:12,455 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:12,455 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:12,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,456 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,556 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:12,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:12,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:12,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:12,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,572 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:12,572 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:12,572 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:12,572 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:12,573 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,573 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,580 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:12,580 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:12,581 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:12,581 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:12,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,583 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:12,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:12,584 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:12,584 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:12,584 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:12,584 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:12,584 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:12,584 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:12,585 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:12,585 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:09:13,014 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dbb47f3d3e8b4130aed4653643d4bfee to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dbb47f3d3e8b4130aed4653643d4bfee 2023-02-13 10:09:13,423 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/ac67627523544e85921cf4349c608b41 2023-02-13 10:09:13,437 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/ac67627523544e85921cf4349c608b41 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41 2023-02-13 10:09:13,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:09:13,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 857ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:13,443 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:13,443 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:13,443 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:13,443 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:13,443 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,443 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:13,443 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:13,472 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,472 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:13,472 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,472 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:13,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:13,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@731da5c7[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:13,474 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:13,474 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,480 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,480 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:13,480 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:13,480 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:13,481 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,481 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:13,489 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:13,489 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:13,489 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:13,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:13,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:13,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:13,493 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:13,493 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:13,493 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:13,493 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,493 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:13,505 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,505 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,505 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:13,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:13,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:13,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:13,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:13,506 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:13,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:13,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,508 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,544 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:13,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:13,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:13,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:13,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:13,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:13,545 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:13,545 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:13,546 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:13,547 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:13,647 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:13,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:13,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,655 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:13,655 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:13,655 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:13,655 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:13,656 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,656 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,671 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,671 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:13,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:13,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:13,672 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:13,672 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:13,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:13,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:13,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:13,674 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:13,674 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:13,674 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:13,674 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:13,674 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:13,674 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:13,674 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:13,674 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:14,098 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201da498f9cc55c42e39be5945b4e3d7efb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201da498f9cc55c42e39be5945b4e3d7efb 2023-02-13 10:09:14,507 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/84f4665d3ce94d7da5ca9aec729bbd94 2023-02-13 10:09:14,518 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/84f4665d3ce94d7da5ca9aec729bbd94 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94 2023-02-13 10:09:14,523 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 10:09:14,524 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 850ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:14,524 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:14,524 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:14,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:14,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:14,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:14,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:14,555 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,555 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:14,556 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,556 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:14,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:14,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56acaa48[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:14,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:14,558 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,563 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,564 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:14,564 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:14,564 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:14,564 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,564 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:14,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:14,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:14,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:14,572 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:14,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:14,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:14,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:14,577 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:14,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:14,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:14,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,578 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:14,589 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,589 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:14,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,589 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:14,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:14,590 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,593 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:14,605 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:14,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:14,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:14,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:14,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:14,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:14,606 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,607 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:14,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:14,707 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:14,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:14,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:14,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:14,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,716 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:14,716 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:14,716 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:14,716 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:14,717 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,717 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,722 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,722 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:14,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:14,723 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:14,723 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:14,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:14,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:14,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:14,726 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:14,726 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:14,726 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:14,726 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:14,726 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:14,726 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:15,148 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053e0eeca340974ecaa5cdd874dcf32e00 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e0eeca340974ecaa5cdd874dcf32e00 2023-02-13 10:09:15,556 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/596be6b13ef64e5a969f60357abf0eed 2023-02-13 10:09:15,567 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/596be6b13ef64e5a969f60357abf0eed as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed 2023-02-13 10:09:15,571 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 10:09:15,572 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 846ms, sequenceid=17, compaction requested=true 2023-02-13 10:09:15,572 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:15,572 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:15,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:15,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:15,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:15,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:15,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,605 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:15,606 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,606 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:15,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:15,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66f89f4[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:15,608 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:15,608 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,613 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:15,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:15,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:15,614 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,614 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:15,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:15,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:15,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:15,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:15,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:15,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:15,626 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:15,626 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:15,626 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:15,626 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,626 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:15,630 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,630 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:15,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:15,630 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:15,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:15,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:15,631 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:15,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:15,633 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,638 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,638 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,638 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,638 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:15,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:15,639 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:15,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:15,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:15,639 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:15,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:15,740 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:15,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:15,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:15,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:15,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,751 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:15,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:15,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:15,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:15,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,778 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:15,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:15,779 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:15,779 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,780 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,780 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:15,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:15,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:15,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:15,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:15,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:15,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:15,781 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:15,781 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:15,781 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:16,093 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:09:16,198 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228367a64d7e5e04fffb8b41788a0a84c8f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228367a64d7e5e04fffb8b41788a0a84c8f 2023-02-13 10:09:16,605 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/695e8ad88b364945b4b9a64a4f85e438 2023-02-13 10:09:16,614 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/695e8ad88b364945b4b9a64a4f85e438 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438 2023-02-13 10:09:16,621 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 10:09:16,622 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 841ms, sequenceid=21, compaction requested=true 2023-02-13 10:09:16,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:16,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:16,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:16,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:16,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:16,623 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:16,655 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,655 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:16,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:16,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:16,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14a86fa7[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:16,658 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:16,658 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,663 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:16,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:16,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:16,664 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,664 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:16,672 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,672 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:16,672 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:16,672 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:16,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:16,677 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:16,677 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:16,677 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:16,677 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,677 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:16,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:16,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:16,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:16,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:16,690 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,704 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:16,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:16,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:16,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:16,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:16,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:16,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,705 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,705 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,705 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:16,705 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:16,705 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:16,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:16,806 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:16,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:16,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:16,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:16,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,819 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:16,819 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:16,820 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:16,820 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:16,820 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,821 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,855 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,855 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:16,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:16,856 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:16,856 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:16,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,860 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:16,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:16,860 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:16,860 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:16,860 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:16,860 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:16,860 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:16,860 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:16,861 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:16,861 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:17,298 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:17,298 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de30b5a to 127.0.0.1:57475 2023-02-13 10:09:17,298 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:17,299 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:17,299 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x030477d0 to 127.0.0.1:57475 2023-02-13 10:09:17,299 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:17,299 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:17,299 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73e0a974 to 127.0.0.1:57475 2023-02-13 10:09:17,299 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:17,301 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311c3c47d08966402b97268e7595066c89 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311c3c47d08966402b97268e7595066c89 2023-02-13 10:09:17,706 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/35d8f579f16f456a8fee1d9255ae65fa 2023-02-13 10:09:17,718 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/35d8f579f16f456a8fee1d9255ae65fa as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa 2023-02-13 10:09:17,726 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 10:09:17,727 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 866ms, sequenceid=25, compaction requested=true 2023-02-13 10:09:17,727 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:17,727 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:17,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:17,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:17,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:17,727 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:17,755 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:17,757 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,757 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:17,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:17,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a05c368[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:17,762 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:17,762 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,772 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,772 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:17,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:17,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:17,773 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,773 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:17,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:17,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:17,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:17,780 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:17,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:17,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:17,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:17,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:17,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:17,785 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:17,785 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:17,785 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:17,785 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,785 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:17,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:17,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:17,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:17,790 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,792 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,804 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,804 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:17,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:17,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:17,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:17,804 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:17,806 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:17,805 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:17,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:17,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:17,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:17,906 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:17,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,911 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:17,911 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:17,911 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:17,911 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:17,912 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,912 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,922 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,922 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:17,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:17,922 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:17,922 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,923 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:17,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:17,924 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:17,924 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:17,924 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:17,924 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:17,924 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:17,924 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:17,924 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:17,924 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:18,348 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015ec5e01d9430443287a3559e43fb018b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015ec5e01d9430443287a3559e43fb018b 2023-02-13 10:09:18,757 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/dce30a9f73674fe29e9028ddd4f9647d 2023-02-13 10:09:18,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/dce30a9f73674fe29e9028ddd4f9647d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d 2023-02-13 10:09:18,774 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 10:09:18,775 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 851ms, sequenceid=29, compaction requested=true 2023-02-13 10:09:18,775 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:18,775 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:18,775 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:18,775 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:18,775 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,775 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:18,775 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:18,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,805 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:18,806 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,806 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:18,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:18,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3948c68a[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:18,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:18,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,813 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:18,814 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:18,814 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:18,814 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,814 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:18,845 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:18,845 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:18,845 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:18,845 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:18,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:18,852 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:18,852 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:18,852 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:18,852 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,852 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:18,863 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,864 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:18,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,863 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:18,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:18,865 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,868 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,880 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:18,880 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,880 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,880 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,881 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:18,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:18,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:18,880 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:18,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:18,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:18,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:18,881 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:18,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:18,882 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:18,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:18,882 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:18,982 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:18,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:18,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:18,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:18,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,998 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:18,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:18,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:18,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:18,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:18,998 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,005 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:19,005 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:19,006 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,006 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,007 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,007 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:19,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,007 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:19,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:19,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:19,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:19,008 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:19,008 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:19,008 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:19,008 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:19,434 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a2218ce4e17e4c199089188e3e6141c8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2218ce4e17e4c199089188e3e6141c8 2023-02-13 10:09:19,841 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/15828f27fcdc4f5e8a06b110801cb638 2023-02-13 10:09:19,849 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/15828f27fcdc4f5e8a06b110801cb638 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638 2023-02-13 10:09:19,856 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 10:09:19,857 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 849ms, sequenceid=33, compaction requested=true 2023-02-13 10:09:19,857 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:19,857 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:19,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:19,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:19,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:19,857 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:19,888 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,888 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:19,889 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,889 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:19,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:19,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4392c87e[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:19,894 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:19,894 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,904 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:19,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:19,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:19,905 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,905 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:19,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:19,914 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:19,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:19,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:19,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:19,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:19,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:19,923 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:19,924 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:19,924 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:19,924 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,924 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:19,930 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,930 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,930 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:19,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:19,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:19,931 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,932 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,938 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:19,938 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,939 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:19,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:19,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:19,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:19,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:19,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,939 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,940 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:19,940 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:19,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:19,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:19,940 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:20,040 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:20,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:20,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:20,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,054 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:20,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:20,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:20,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:20,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,063 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:20,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:20,064 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,064 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,065 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:20,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,066 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:20,066 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:20,066 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:20,066 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:20,066 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:20,066 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:20,066 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:20,066 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:20,493 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e47b887b7a8d4e1da53335c32b79cebc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907e47b887b7a8d4e1da53335c32b79cebc 2023-02-13 10:09:20,500 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/98861d32958f4c96a299d7054dd916ee 2023-02-13 10:09:20,507 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/98861d32958f4c96a299d7054dd916ee as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee 2023-02-13 10:09:20,512 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 10:09:20,513 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 447ms, sequenceid=37, compaction requested=true 2023-02-13 10:09:20,513 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:20,513 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:20,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:20,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:20,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:20,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:20,530 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:20,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,531 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:20,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:20,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@141052fc[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:20,532 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:20,532 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,588 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:20,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:20,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:20,589 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,589 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:20,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:20,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:20,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:20,597 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:20,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:20,600 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:20,600 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:20,600 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:20,600 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,600 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:20,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:20,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:20,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:20,606 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,607 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,661 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,662 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:20,661 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:20,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:20,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:20,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,662 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:20,663 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:20,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:20,763 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:20,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:20,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:20,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:20,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,777 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:20,777 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:20,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 10:09:20,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 10:09:20,779 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,779 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,789 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:20,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:20,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:20,790 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:20,790 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:20,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 10:09:20,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:20,792 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 10:09:20,792 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:20,792 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 10:09:20,793 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:20,793 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:20,793 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:20,793 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. started... 2023-02-13 10:09:20,793 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7074ad7e4dc5391d9000c2a69a333 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:21,216 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112072f959a5b3184a68a456a25bf41bb908 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112072f959a5b3184a68a456a25bf41bb908 2023-02-13 10:09:21,625 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/36013666c5b1439ebe24f590dd4f5127 2023-02-13 10:09:21,637 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/36013666c5b1439ebe24f590dd4f5127 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127 2023-02-13 10:09:21,642 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 10:09:21,643 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for feb7074ad7e4dc5391d9000c2a69a333 in 850ms, sequenceid=41, compaction requested=true 2023-02-13 10:09:21,643 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:21,643 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:21,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:21,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:21,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,643 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 10:09:21,644 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 10:09:21,672 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,672 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:21,672 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,673 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:21,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 10:09:21,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30aadd95[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:21,677 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 10:09:21,677 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,688 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,688 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 10:09:21,688 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 10:09:21,688 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:21,689 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,689 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:21,697 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,697 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 10:09:21,697 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:21,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:21,697 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 10:09:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:21,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:21,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 10:09:21,707 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 10:09:21,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:21,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:21,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,708 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:21,713 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,713 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,714 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:21,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:21,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:21,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:21,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:21,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:21,715 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:21,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,717 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,729 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:21,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 10:09:21,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:21,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:21,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:21,730 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:21,729 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,730 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:21,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:21,730 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,730 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,830 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:21,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:21,834 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:21,837 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:21,839 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:21,841 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:21,841 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283561841 2023-02-13 10:09:21,845 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:21,847 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 10:09:21,847 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:21,847 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x6cff7f22 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:21,856 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3819c6d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:21,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,702 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039a0e50cfb46e4c859614b14f708e2390 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039a0e50cfb46e4c859614b14f708e2390 2023-02-13 10:09:22,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:22,717 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:22,719 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:51876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:22,724 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:22,726 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40060, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:22,736 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ad41692083e4819b75f7da05a77eb11 first=Optional[r3] last=Optional[r6] 2023-02-13 10:09:22,737 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ad41692083e4819b75f7da05a77eb11}] 2023-02-13 10:09:22,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ad41692083e4819b75f7da05a77eb11 for inclusion in feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:22,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 10:09:22,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:22,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:22,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ad41692083e4819b75f7da05a77eb11 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nnekj0g76njpvfcp8a3tli3lad4fr6s79hou33shp2vb5u6m2gu41mdjj0e3vhsv/family1/0ad41692083e4819b75f7da05a77eb11 2023-02-13 10:09:22,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nnekj0g76njpvfcp8a3tli3lad4fr6s79hou33shp2vb5u6m2gu41mdjj0e3vhsv/family1/0ad41692083e4819b75f7da05a77eb11 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_ 2023-02-13 10:09:22,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nnekj0g76njpvfcp8a3tli3lad4fr6s79hou33shp2vb5u6m2gu41mdjj0e3vhsv/family1/0ad41692083e4819b75f7da05a77eb11 into feb7074ad7e4dc5391d9000c2a69a333/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_ - updating store file list. 2023-02-13 10:09:22,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_ into feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:22,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nnekj0g76njpvfcp8a3tli3lad4fr6s79hou33shp2vb5u6m2gu41mdjj0e3vhsv/family1/0ad41692083e4819b75f7da05a77eb11 into feb7074ad7e4dc5391d9000c2a69a333/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_) 2023-02-13 10:09:22,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nnekj0g76njpvfcp8a3tli3lad4fr6s79hou33shp2vb5u6m2gu41mdjj0e3vhsv/family1/0ad41692083e4819b75f7da05a77eb11 2023-02-13 10:09:22,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:09:22,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:09:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): feb7074ad7e4dc5391d9000c2a69a333/family1 is initiating minor compaction 2023-02-13 10:09:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40ce3e48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:22,755 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of feb7074ad7e4dc5391d9000c2a69a333/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:22,755 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp, totalSize=50.4 K 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting ac67627523544e85921cf4349c608b41, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 84f4665d3ce94d7da5ca9aec729bbd94, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 596be6b13ef64e5a969f60357abf0eed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 695e8ad88b364945b4b9a64a4f85e438, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 35d8f579f16f456a8fee1d9255ae65fa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting dce30a9f73674fe29e9028ddd4f9647d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 15828f27fcdc4f5e8a06b110801cb638, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 98861d32958f4c96a299d7054dd916ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:09:22,755 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 36013666c5b1439ebe24f590dd4f5127, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:09:22,756 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 7d081e0c656d4d1593d814a2b1611090_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:09:22,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:22,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:22,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228367a64d7e5e04fffb8b41788a0a84c8f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228367a64d7e5e04fffb8b41788a0a84c8f 2023-02-13 10:09:22,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311c3c47d08966402b97268e7595066c89 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311c3c47d08966402b97268e7595066c89 2023-02-13 10:09:22,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015ec5e01d9430443287a3559e43fb018b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015ec5e01d9430443287a3559e43fb018b 2023-02-13 10:09:22,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2218ce4e17e4c199089188e3e6141c8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2218ce4e17e4c199089188e3e6141c8 2023-02-13 10:09:22,762 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-13 10:09:22,762 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:22,782 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): feb7074ad7e4dc5391d9000c2a69a333#family1#compaction#61 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:23,210 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/7a248ab5968240f3b20e025c8520410c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7a248ab5968240f3b20e025c8520410c 2023-02-13 10:09:23,215 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in feb7074ad7e4dc5391d9000c2a69a333/family1 of feb7074ad7e4dc5391d9000c2a69a333 into 7a248ab5968240f3b20e025c8520410c(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:09:23,215 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:23,216 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676282962755; duration=0sec 2023-02-13 10:09:23,216 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:23,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_] to archive 2023-02-13 10:09:23,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:23,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/ac67627523544e85921cf4349c608b41 2023-02-13 10:09:23,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/84f4665d3ce94d7da5ca9aec729bbd94 2023-02-13 10:09:23,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/596be6b13ef64e5a969f60357abf0eed 2023-02-13 10:09:23,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/695e8ad88b364945b4b9a64a4f85e438 2023-02-13 10:09:23,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/35d8f579f16f456a8fee1d9255ae65fa 2023-02-13 10:09:23,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/dce30a9f73674fe29e9028ddd4f9647d 2023-02-13 10:09:23,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/15828f27fcdc4f5e8a06b110801cb638 2023-02-13 10:09:23,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/98861d32958f4c96a299d7054dd916ee 2023-02-13 10:09:23,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/36013666c5b1439ebe24f590dd4f5127 2023-02-13 10:09:23,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7d081e0c656d4d1593d814a2b1611090_SeqId_44_ 2023-02-13 10:09:23,611 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5421d7c91a94259a99a10bffa657eb3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5421d7c91a94259a99a10bffa657eb3 2023-02-13 10:09:23,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:23,637 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5b82fcb989444eca08577eedb847ed2 first=Optional[r00] last=Optional[r2] 2023-02-13 10:09:23,638 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5b82fcb989444eca08577eedb847ed2}] 2023-02-13 10:09:23,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5b82fcb989444eca08577eedb847ed2 for inclusion in feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 10:09:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:23,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5b82fcb989444eca08577eedb847ed2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lt7dl0s23f363hbkt3qc6ugrmldlsh951ve00vkf70ru80hcern7qne5khp275gg/family1/f5b82fcb989444eca08577eedb847ed2 2023-02-13 10:09:23,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lt7dl0s23f363hbkt3qc6ugrmldlsh951ve00vkf70ru80hcern7qne5khp275gg/family1/f5b82fcb989444eca08577eedb847ed2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_ 2023-02-13 10:09:23,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lt7dl0s23f363hbkt3qc6ugrmldlsh951ve00vkf70ru80hcern7qne5khp275gg/family1/f5b82fcb989444eca08577eedb847ed2 into feb7074ad7e4dc5391d9000c2a69a333/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_ - updating store file list. 2023-02-13 10:09:23,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_ into feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:23,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lt7dl0s23f363hbkt3qc6ugrmldlsh951ve00vkf70ru80hcern7qne5khp275gg/family1/f5b82fcb989444eca08577eedb847ed2 into feb7074ad7e4dc5391d9000c2a69a333/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_) 2023-02-13 10:09:23,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lt7dl0s23f363hbkt3qc6ugrmldlsh951ve00vkf70ru80hcern7qne5khp275gg/family1/f5b82fcb989444eca08577eedb847ed2 2023-02-13 10:09:23,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:09:23,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:09:23,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): feb7074ad7e4dc5391d9000c2a69a333/family1 is initiating minor compaction (all files) 2023-02-13 10:09:23,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8f85d8b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 10:09:23,654 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of feb7074ad7e4dc5391d9000c2a69a333/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:23,654 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7a248ab5968240f3b20e025c8520410c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp, totalSize=390.1 K 2023-02-13 10:09:23,655 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 747a8ff1c6dc4d4d94b70e0bc7909a1c, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:09:23,655 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 7a248ab5968240f3b20e025c8520410c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:09:23,656 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806172 2023-02-13 10:09:23,656 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:23,657 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:23,658 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130520f883743d342d28dbf4e1c62219f7c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130520f883743d342d28dbf4e1c62219f7c 2023-02-13 10:09:23,659 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201da498f9cc55c42e39be5945b4e3d7efb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201da498f9cc55c42e39be5945b4e3d7efb 2023-02-13 10:09:23,661 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e0eeca340974ecaa5cdd874dcf32e00 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e0eeca340974ecaa5cdd874dcf32e00 2023-02-13 10:09:23,661 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-13 10:09:23,661 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 10:09:23,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:23,661 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:23,661 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:23,663 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:23,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8280 sec 2023-02-13 10:09:23,672 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): feb7074ad7e4dc5391d9000c2a69a333#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:23,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 10:09:23,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:24,144 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:24,146 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:24,147 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:24,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 10:09:24,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE}] 2023-02-13 10:09:24,156 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE 2023-02-13 10:09:24,157 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:24,157 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282964157"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282964157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282964157"}]},"ts":"1676282964157"} 2023-02-13 10:09:24,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:24,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing feb7074ad7e4dc5391d9000c2a69a333, disabling compactions & flushes 2023-02-13 10:09:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:24,907 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/.tmp/family1/f2dda6aa0ec24d8c916172bd4d1cfd1b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/f2dda6aa0ec24d8c916172bd4d1cfd1b 2023-02-13 10:09:24,914 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in feb7074ad7e4dc5391d9000c2a69a333/family1 of feb7074ad7e4dc5391d9000c2a69a333 into f2dda6aa0ec24d8c916172bd4d1cfd1b(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:09:24,914 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:24,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:24,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:24,914 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676282963654; duration=1sec 2023-02-13 10:09:24,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. after waiting 0 ms 2023-02-13 10:09:24,914 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:24,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:24,916 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7a248ab5968240f3b20e025c8520410c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_] to archive 2023-02-13 10:09:24,916 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:24,919 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/747a8ff1c6dc4d4d94b70e0bc7909a1c 2023-02-13 10:09:24,921 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7a248ab5968240f3b20e025c8520410c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/7a248ab5968240f3b20e025c8520410c 2023-02-13 10:09:24,922 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/887ddcb7dc5c4b5f8b5195885fe78d6e_SeqId_47_ 2023-02-13 10:09:24,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 10:09:24,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:24,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for feb7074ad7e4dc5391d9000c2a69a333: Waiting for close lock at 1676282964312Running coprocessor pre-close hooks at 1676282964312Disabling compacts and flushes for region at 1676282964312Disabling writes for close at 1676282964914 (+602 ms)Writing region close event to WAL at 1676282964925 (+11 ms)Running coprocessor post-close hooks at 1676282964929 (+4 ms)Closed at 1676282964930 (+1 ms) 2023-02-13 10:09:24,930 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: feb7074ad7e4dc5391d9000c2a69a333 to self. 2023-02-13 10:09:24,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:24,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=CLOSED 2023-02-13 10:09:24,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282964932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282964932"}]},"ts":"1676282964932"} 2023-02-13 10:09:24,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-13 10:09:24,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622 in 775 msec 2023-02-13 10:09:24,937 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=true 2023-02-13 10:09:25,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:25,088 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282965088"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282965088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282965088"}]},"ts":"1676282965088"} 2023-02-13 10:09:25,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:25,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:25,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => feb7074ad7e4dc5391d9000c2a69a333, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:25,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:25,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,258 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,261 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:25,261 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:25,262 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7074ad7e4dc5391d9000c2a69a333 columnFamilyName family1 2023-02-13 10:09:25,269 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/f2dda6aa0ec24d8c916172bd4d1cfd1b 2023-02-13 10:09:25,269 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(310): Store=feb7074ad7e4dc5391d9000c2a69a333/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:25,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:25,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened feb7074ad7e4dc5391d9000c2a69a333; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63442545, jitterRate=-0.054632410407066345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for feb7074ad7e4dc5391d9000c2a69a333: Running coprocessor pre-open hook at 1676282965255Writing region info on filesystem at 1676282965255Initializing all the Stores at 1676282965257 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676282965257Cleaning up temporary data from old regions at 1676282965272 (+15 ms)Cleaning up detritus from prior splits at 1676282965272Running coprocessor post-open hooks at 1676282965276 (+4 ms)Region opened successfully at 1676282965276 2023-02-13 10:09:25,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., pid=47, masterSystemTime=1676282965247 2023-02-13 10:09:25,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:25,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:25,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:25,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282965279"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282965279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282965279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282965279"}]},"ts":"1676282965279"} 2023-02-13 10:09:25,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-13 10:09:25,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622 in 189 msec 2023-02-13 10:09:25,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-13 10:09:25,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE in 1.1280 sec 2023-02-13 10:09:25,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 10:09:25,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1350 sec 2023-02-13 10:09:25,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5570 sec 2023-02-13 10:09:25,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-13 10:09:25,293 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(278): alter status finished 2023-02-13 10:09:25,294 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:25,295 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:25,296 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:25,297 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283565297 2023-02-13 10:09:25,297 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:25,297 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:25,298 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 10:09:25,298 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:25,298 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x34d147a3 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:25,400 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@420878e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:25,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:25,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:25,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:25,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:25,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:26,258 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ed843ae802274db991e3041506ad5f9c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ed843ae802274db991e3041506ad5f9c 2023-02-13 10:09:26,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:26,273 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:26,274 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:51888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:26,280 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:26,281 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:26,289 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f198b8d734744901b0c586be5d60b3ff first=Optional[r05] last=Optional[r8] 2023-02-13 10:09:26,290 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f198b8d734744901b0c586be5d60b3ff}] 2023-02-13 10:09:26,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f198b8d734744901b0c586be5d60b3ff for inclusion in feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:26,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 10:09:26,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:26,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for feb7074ad7e4dc5391d9000c2a69a333: 2023-02-13 10:09:26,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f198b8d734744901b0c586be5d60b3ff to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hcs910pevhh1rvrvnv11f1dpt2ujksdlutjap58r0gujci14prhhp5b37hedpnau/family1/f198b8d734744901b0c586be5d60b3ff 2023-02-13 10:09:26,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hcs910pevhh1rvrvnv11f1dpt2ujksdlutjap58r0gujci14prhhp5b37hedpnau/family1/f198b8d734744901b0c586be5d60b3ff as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/cb48353556ef4ecc9024de9b40dd63f2_SeqId_53_ 2023-02-13 10:09:26,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hcs910pevhh1rvrvnv11f1dpt2ujksdlutjap58r0gujci14prhhp5b37hedpnau/family1/f198b8d734744901b0c586be5d60b3ff into feb7074ad7e4dc5391d9000c2a69a333/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/cb48353556ef4ecc9024de9b40dd63f2_SeqId_53_ - updating store file list. 2023-02-13 10:09:26,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/cb48353556ef4ecc9024de9b40dd63f2_SeqId_53_ into feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:26,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hcs910pevhh1rvrvnv11f1dpt2ujksdlutjap58r0gujci14prhhp5b37hedpnau/family1/f198b8d734744901b0c586be5d60b3ff into feb7074ad7e4dc5391d9000c2a69a333/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/cb48353556ef4ecc9024de9b40dd63f2_SeqId_53_) 2023-02-13 10:09:26,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hcs910pevhh1rvrvnv11f1dpt2ujksdlutjap58r0gujci14prhhp5b37hedpnau/family1/f198b8d734744901b0c586be5d60b3ff 2023-02-13 10:09:26,308 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:26,308 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:26,310 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112072f959a5b3184a68a456a25bf41bb908 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112072f959a5b3184a68a456a25bf41bb908 2023-02-13 10:09:26,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dbb47f3d3e8b4130aed4653643d4bfee to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dbb47f3d3e8b4130aed4653643d4bfee 2023-02-13 10:09:26,311 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-13 10:09:26,311 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 10:09:26,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:26,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:26,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:26,311 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:26,311 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:26,312 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:26,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.0180 sec 2023-02-13 10:09:26,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:09:26,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:26,779 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 10:09:26,781 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:26,781 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 10:09:26,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 10:09:26,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE}] 2023-02-13 10:09:26,793 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE 2023-02-13 10:09:26,794 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:26,794 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282966794"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282966794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282966794"}]},"ts":"1676282966794"} 2023-02-13 10:09:26,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:26,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:26,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing feb7074ad7e4dc5391d9000c2a69a333, disabling compactions & flushes 2023-02-13 10:09:26,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:26,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:26,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. after waiting 0 ms 2023-02-13 10:09:26,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:26,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 10:09:26,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:26,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for feb7074ad7e4dc5391d9000c2a69a333: Waiting for close lock at 1676282966949Running coprocessor pre-close hooks at 1676282966949Disabling compacts and flushes for region at 1676282966949Disabling writes for close at 1676282966949Writing region close event to WAL at 1676282966953 (+4 ms)Running coprocessor post-close hooks at 1676282966961 (+8 ms)Closed at 1676282966961 2023-02-13 10:09:26,961 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: feb7074ad7e4dc5391d9000c2a69a333 to self. 2023-02-13 10:09:26,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:26,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=CLOSED 2023-02-13 10:09:26,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282966963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282966963"}]},"ts":"1676282966963"} 2023-02-13 10:09:26,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-13 10:09:26,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622 in 169 msec 2023-02-13 10:09:26,967 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=true 2023-02-13 10:09:27,118 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:27,118 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282967118"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282967118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282967118"}]},"ts":"1676282967118"} 2023-02-13 10:09:27,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:27,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:27,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => feb7074ad7e4dc5391d9000c2a69a333, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:27,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:27,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,285 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,286 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:27,286 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1 2023-02-13 10:09:27,286 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7074ad7e4dc5391d9000c2a69a333 columnFamilyName family1 2023-02-13 10:09:27,291 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/cb48353556ef4ecc9024de9b40dd63f2_SeqId_53_ 2023-02-13 10:09:27,294 DEBUG [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/family1/f2dda6aa0ec24d8c916172bd4d1cfd1b 2023-02-13 10:09:27,294 INFO [StoreOpener-feb7074ad7e4dc5391d9000c2a69a333-1] regionserver.HStore(310): Store=feb7074ad7e4dc5391d9000c2a69a333/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:27,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:09:27,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened feb7074ad7e4dc5391d9000c2a69a333; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70215084, jitterRate=0.04628628492355347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:27,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for feb7074ad7e4dc5391d9000c2a69a333: Running coprocessor pre-open hook at 1676282967283Writing region info on filesystem at 1676282967283Initializing all the Stores at 1676282967284 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282967285 (+1 ms)Cleaning up temporary data from old regions at 1676282967296 (+11 ms)Cleaning up detritus from prior splits at 1676282967297 (+1 ms)Running coprocessor post-open hooks at 1676282967299 (+2 ms)Region opened successfully at 1676282967299 2023-02-13 10:09:27,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333., pid=53, masterSystemTime=1676282967274 2023-02-13 10:09:27,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:27,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:09:27,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=feb7074ad7e4dc5391d9000c2a69a333, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:27,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676282967302"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282967302"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282967302"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282967302"}]},"ts":"1676282967302"} 2023-02-13 10:09:27,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-13 10:09:27,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure feb7074ad7e4dc5391d9000c2a69a333, server=jenkins-hbase16.apache.org,38311,1676282881622 in 182 msec 2023-02-13 10:09:27,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-13 10:09:27,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=feb7074ad7e4dc5391d9000c2a69a333, REOPEN/MOVE in 512 msec 2023-02-13 10:09:27,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-13 10:09:27,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 521 msec 2023-02-13 10:09:27,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 942 msec 2023-02-13 10:09:27,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-13 10:09:27,312 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(278): alter status finished 2023-02-13 10:09:27,313 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 10:09:27,314 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:27,315 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:27,315 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283567315 2023-02-13 10:09:27,315 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:27,316 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:27,317 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 10:09:27,317 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:27,317 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x0cad2f93 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:27,348 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d63b1a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:27,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 10:09:27,349 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 10:09:27,349 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:27,351 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 10:09:27,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 38 msec 2023-02-13 10:09:27,422 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=240 (was 249), OpenFileDescriptor=608 (was 611), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 156), ProcessCount=165 (was 165), AvailableMemoryMB=7824 (was 7880) 2023-02-13 10:09:27,431 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=165, AvailableMemoryMB=7824 2023-02-13 10:09:27,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 10:09:27,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:27,436 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:09:27,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-13 10:09:27,437 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:09:27,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:27,438 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:27,438 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a empty. 2023-02-13 10:09:27,439 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:27,439 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-13 10:09:27,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:27,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:27,850 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:27,853 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => c6552cd4e72d5ca6219b168bcf32684a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:28,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:28,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:28,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing c6552cd4e72d5ca6219b168bcf32684a, disabling compactions & flushes 2023-02-13 10:09:28,265 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. after waiting 0 ms 2023-02-13 10:09:28,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,265 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,266 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for c6552cd4e72d5ca6219b168bcf32684a: Waiting for close lock at 1676282968265Disabling compacts and flushes for region at 1676282968265Disabling writes for close at 1676282968265Writing region close event to WAL at 1676282968265Closed at 1676282968265 2023-02-13 10:09:28,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:09:28,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282968275"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282968275"}]},"ts":"1676282968275"} 2023-02-13 10:09:28,277 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:09:28,278 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:09:28,278 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282968278"}]},"ts":"1676282968278"} 2023-02-13 10:09:28,280 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-13 10:09:28,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, ASSIGN}] 2023-02-13 10:09:28,325 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, ASSIGN 2023-02-13 10:09:28,327 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:28,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:28,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282968478"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282968478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282968478"}]},"ts":"1676282968478"} 2023-02-13 10:09:28,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:28,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:28,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c6552cd4e72d5ca6219b168bcf32684a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:28,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:28,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,647 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,649 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:28,649 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:28,649 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6552cd4e72d5ca6219b168bcf32684a columnFamilyName family1 2023-02-13 10:09:28,651 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(310): Store=c6552cd4e72d5ca6219b168bcf32684a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:28,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:28,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:28,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened c6552cd4e72d5ca6219b168bcf32684a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75302208, jitterRate=0.12209033966064453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:28,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for c6552cd4e72d5ca6219b168bcf32684a: Running coprocessor pre-open hook at 1676282968644Writing region info on filesystem at 1676282968644Initializing all the Stores at 1676282968646 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676282968646Cleaning up temporary data from old regions at 1676282968654 (+8 ms)Cleaning up detritus from prior splits at 1676282968655 (+1 ms)Running coprocessor post-open hooks at 1676282968663 (+8 ms)Region opened successfully at 1676282968663 2023-02-13 10:09:28,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., pid=57, masterSystemTime=1676282968634 2023-02-13 10:09:28,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:28,667 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:28,667 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282968666"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282968666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282968666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282968666"}]},"ts":"1676282968666"} 2023-02-13 10:09:28,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-13 10:09:28,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 188 msec 2023-02-13 10:09:28,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-13 10:09:28,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, ASSIGN in 349 msec 2023-02-13 10:09:28,673 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:09:28,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282968673"}]},"ts":"1676282968673"} 2023-02-13 10:09:28,675 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-13 10:09:28,680 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:09:28,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2460 sec 2023-02-13 10:09:29,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 10:09:29,549 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-13 10:09:29,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:29,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,577 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:29,577 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:29,577 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:29,577 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:29,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,605 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:29,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:29,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:29,605 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:29,605 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:29,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:29,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:29,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:29,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:29,607 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:29,607 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:29,607 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:29,607 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:09:30,026 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d834f521e2024d6c859c7d245e0ed6d7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d834f521e2024d6c859c7d245e0ed6d7 2023-02-13 10:09:30,431 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/eb27b54665654da985bd4a440148f871 2023-02-13 10:09:30,441 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/eb27b54665654da985bd4a440148f871 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871 2023-02-13 10:09:30,446 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-13 10:09:30,447 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 840ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:30,447 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:30,448 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:30,448 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:30,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:30,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:30,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:30,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:30,461 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:09:30,501 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,501 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:30,502 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,502 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:30,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:30,503 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:30,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fa9319c[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:30,503 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,513 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,513 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,513 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:30,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:30,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:30,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:30,521 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:30,521 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,521 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:30,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:30,521 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:30,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:30,523 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:30,524 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:30,524 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:30,524 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,524 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:30,530 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:30,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:30,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:30,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,531 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:30,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:30,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:30,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:30,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:30,560 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:30,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:30,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,561 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:30,661 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:30,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:30,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:30,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:30,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,667 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:30,667 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:30,667 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:30,667 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:30,668 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,668 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,680 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:30,680 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:30,680 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:30,680 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,681 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,681 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:30,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:30,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:30,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:30,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:30,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:30,682 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:30,682 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:30,682 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:30,682 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:09:31,100 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286040b7e221fe4e9da3f63535f8ba2d39 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286040b7e221fe4e9da3f63535f8ba2d39 2023-02-13 10:09:31,507 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/bb9c1bcbd30347e58b9bcda19b959069 2023-02-13 10:09:31,518 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/bb9c1bcbd30347e58b9bcda19b959069 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069 2023-02-13 10:09:31,523 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:09:31,524 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 842ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:31,524 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:31,524 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:31,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:31,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:31,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:31,524 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:31,555 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,555 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:31,555 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:31,556 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:31,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:31,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2dd12f[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:31,560 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:31,560 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,571 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,571 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:31,571 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:31,571 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:31,571 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,572 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:31,580 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:31,580 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,580 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:31,580 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:31,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:31,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:31,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:31,589 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:31,589 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:31,589 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:31,589 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,590 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:31,596 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,596 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,597 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:31,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:31,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:31,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:31,598 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,600 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:31,640 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:31,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:31,640 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:31,639 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:31,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:31,640 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:31,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:31,641 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,642 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,742 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:31,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:31,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:31,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:31,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,750 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:31,750 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:31,750 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:31,750 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:31,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,751 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,770 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,770 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:31,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:31,771 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:31,771 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:31,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:31,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:31,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:31,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:31,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:31,773 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:31,773 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:31,773 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:31,773 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:32,192 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a8e405a03ed84dbb82a8e9b03459b30a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a8e405a03ed84dbb82a8e9b03459b30a 2023-02-13 10:09:32,601 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/223b8ba08c9448a1a3b17757628b4c56 2023-02-13 10:09:32,615 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/223b8ba08c9448a1a3b17757628b4c56 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56 2023-02-13 10:09:32,620 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 10:09:32,621 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 848ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:32,621 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:32,621 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:32,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:32,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:32,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:32,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:32,655 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,655 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:32,655 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:32,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:32,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:32,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:32,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:32,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cbce724[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:32,660 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:32,660 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,671 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,671 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:32,671 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:32,671 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:32,671 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,672 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:32,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:32,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:32,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:32,680 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:32,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:32,691 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:32,691 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:32,691 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:32,691 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,691 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:32,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,704 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:32,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:32,705 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,708 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,720 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,720 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,720 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,720 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,720 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:32,720 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:32,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:32,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:32,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:32,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:32,721 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:32,822 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:32,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:32,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,831 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:32,831 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:32,831 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:32,831 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:32,832 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,832 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,838 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:32,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:32,839 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:32,839 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:32,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:32,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,841 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:32,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:32,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:32,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:32,841 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:32,842 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:32,842 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:32,842 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:32,842 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:32,842 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:33,269 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120542b41c9e630e4872ab00f696f92c3e44 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120542b41c9e630e4872ab00f696f92c3e44 2023-02-13 10:09:33,676 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/16c6bdfe700e4360a13a280651c51dd6 2023-02-13 10:09:33,689 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/16c6bdfe700e4360a13a280651c51dd6 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6 2023-02-13 10:09:33,694 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 10:09:33,695 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 853ms, sequenceid=17, compaction requested=true 2023-02-13 10:09:33,695 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:33,695 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:33,695 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:33,695 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:33,696 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,696 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:33,696 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:33,752 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,752 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:33,753 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,753 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:33,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:33,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a9cd553[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:33,755 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:33,755 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,763 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:33,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:33,763 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:33,763 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,763 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:33,771 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:33,771 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:33,771 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:33,771 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:33,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:33,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:33,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:33,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:33,775 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:33,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:33,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:33,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,775 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:33,779 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,780 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:33,779 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:33,780 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,782 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:33,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:33,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:33,788 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:33,789 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:33,789 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:33,889 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:33,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:33,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:33,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:33,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,903 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:33,903 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:33,903 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:33,903 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:33,904 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,904 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,913 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:33,913 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:33,913 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:33,913 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:33,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:33,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:33,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:33,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:33,914 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:33,915 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:33,915 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:33,915 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:33,915 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:33,915 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:34,333 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122804b0e0f6d699426f8103d9e585951b63 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122804b0e0f6d699426f8103d9e585951b63 2023-02-13 10:09:34,740 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/a59b5fe1392649a489b8a0101c85c30c 2023-02-13 10:09:34,750 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/a59b5fe1392649a489b8a0101c85c30c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c 2023-02-13 10:09:34,754 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 10:09:34,754 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 839ms, sequenceid=21, compaction requested=true 2023-02-13 10:09:34,754 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:34,755 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:34,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:34,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:34,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:34,755 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:34,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:34,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:34,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:34,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cbf2c4d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:34,790 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:34,790 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,796 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,796 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:34,796 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:34,796 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:34,796 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,796 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:34,804 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:34,805 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:34,805 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:34,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:34,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:34,807 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:34,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:34,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:34,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,807 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:34,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:34,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,813 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:34,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,814 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,821 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:34,821 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,821 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:34,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:34,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:34,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:34,821 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:34,821 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:34,821 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:34,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,822 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,922 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:34,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:34,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:34,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:34,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,929 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:34,929 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:34,929 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:34,929 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:34,929 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,929 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,938 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,938 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:34,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:34,938 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:34,938 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:34,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:34,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:34,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:34,940 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:34,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:34,941 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:34,941 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:34,941 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:34,941 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:35,364 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a27142fc33764e6b8ae82d9362e56546 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a27142fc33764e6b8ae82d9362e56546 2023-02-13 10:09:35,769 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5a159f5cf3d24c879f7bf840a0ff4e43 2023-02-13 10:09:35,777 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5a159f5cf3d24c879f7bf840a0ff4e43 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43 2023-02-13 10:09:35,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 10:09:35,786 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 845ms, sequenceid=25, compaction requested=true 2023-02-13 10:09:35,786 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:35,786 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:35,786 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:35,786 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:35,786 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,786 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:35,786 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:35,820 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,820 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:35,821 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,821 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:35,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:35,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@186f2c5c[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:35,823 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:35,823 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,829 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,830 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:35,830 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:35,830 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:35,830 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,830 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:35,838 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:35,838 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,838 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:35,838 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:35,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:35,844 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:35,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:35,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:35,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,845 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:35,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:35,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,882 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:35,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:35,883 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,887 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,920 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:35,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:35,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:35,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:35,920 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:35,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:35,921 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:35,921 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:35,922 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:35,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:35,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:36,022 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:36,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:36,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,034 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:36,034 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:36,035 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:36,035 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:36,035 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,035 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,046 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,046 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:36,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:36,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:36,047 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,047 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:36,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,050 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:36,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,050 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:36,050 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:36,050 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:36,050 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:36,050 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:36,050 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:36,050 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:36,051 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:36,478 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015de6f4db04aa454eaef33fa96651cd4d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601015de6f4db04aa454eaef33fa96651cd4d 2023-02-13 10:09:36,887 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b 2023-02-13 10:09:36,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b 2023-02-13 10:09:36,904 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 10:09:36,905 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 854ms, sequenceid=29, compaction requested=true 2023-02-13 10:09:36,905 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:36,905 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:36,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:36,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:36,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:36,905 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:36,938 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,938 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:36,939 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:36,939 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:36,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:36,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73016db2[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:36,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:36,940 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,946 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,946 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:36,946 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:36,946 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:36,946 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,946 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:36,954 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,954 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:36,954 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:36,954 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:36,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:36,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:36,958 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:36,958 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:36,958 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:36,958 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,958 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:36,963 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,963 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,963 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:36,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,964 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:36,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:36,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:36,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:36,965 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:36,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:36,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:36,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,972 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:36,971 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:36,972 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:36,972 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:36,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:36,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:36,972 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:36,972 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:36,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:36,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:37,073 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:37,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:37,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:37,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,088 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:37,088 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:37,088 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:37,088 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:37,089 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,089 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,096 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:37,096 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:37,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:37,097 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,097 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:37,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:37,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,098 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:37,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:37,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:37,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:37,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:37,098 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:37,098 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:37,098 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:37,098 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:37,511 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010315b7e0e54138426b9979dcd6e30e3349 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010315b7e0e54138426b9979dcd6e30e3349 2023-02-13 10:09:37,917 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/dfea74cdeefd4028b67cb8126f298175 2023-02-13 10:09:37,928 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/dfea74cdeefd4028b67cb8126f298175 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175 2023-02-13 10:09:37,932 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 10:09:37,932 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 834ms, sequenceid=33, compaction requested=true 2023-02-13 10:09:37,933 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:37,933 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:37,933 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:37,933 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:37,933 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,933 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:37,933 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:37,963 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,963 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:37,963 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,963 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:37,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:37,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fbb08cc[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:37,965 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:37,965 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,971 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,971 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:37,971 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:37,971 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:37,971 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,971 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:37,979 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,979 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:37,979 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:37,980 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:37,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:37,982 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:37,982 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:37,982 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:37,982 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,982 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:37,988 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:37,988 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:37,989 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:37,996 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:37,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:37,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:37,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:37,996 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,997 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:37,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:37,997 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:37,997 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:38,097 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:38,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:38,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:38,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:38,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,109 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:38,109 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:38,109 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:38,109 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:38,110 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,110 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,120 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:38,120 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:38,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:38,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:38,121 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:38,121 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:38,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,124 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:38,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:38,124 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:38,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:38,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:38,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:38,125 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:38,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:38,125 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:38,126 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:38,553 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d486e36cf9ac402d9e0665a281c86b9a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907d486e36cf9ac402d9e0665a281c86b9a 2023-02-13 10:09:38,959 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/b7c108d7668e4baa9c1cf3fa8aa399d4 2023-02-13 10:09:38,971 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/b7c108d7668e4baa9c1cf3fa8aa399d4 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4 2023-02-13 10:09:38,975 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 10:09:38,976 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 851ms, sequenceid=37, compaction requested=true 2023-02-13 10:09:38,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:38,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:38,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:38,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:38,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:38,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:38,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:39,004 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,004 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:39,005 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,005 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:39,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:39,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6af39e32[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:39,009 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:39,009 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,013 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,013 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:39,013 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:39,013 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:39,013 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,013 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:39,021 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:39,021 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:39,021 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:39,021 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:39,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:39,028 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:39,028 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:39,028 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:39,028 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,028 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:39,038 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,038 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:39,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,038 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:39,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:39,040 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,044 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:39,055 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:39,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:39,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:39,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:39,054 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:39,055 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:39,055 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:39,055 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:39,155 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:39,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:39,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:39,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:39,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,166 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:39,166 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:39,166 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 10:09:39,166 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 10:09:39,167 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,167 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,171 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:39,171 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:39,172 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:39,172 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 10:09:39,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:39,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 10:09:39,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:39,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 10:09:39,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:09:39,173 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:39,173 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:39,173 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. started... 2023-02-13 10:09:39,173 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c6552cd4e72d5ca6219b168bcf32684a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:09:39,593 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112069a290ea9e964203a3e3dbd5c9b496a3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112069a290ea9e964203a3e3dbd5c9b496a3 2023-02-13 10:09:40,000 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5cad4657a1c046b9bf325869fb2d3c13 2023-02-13 10:09:40,012 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/5cad4657a1c046b9bf325869fb2d3c13 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13 2023-02-13 10:09:40,021 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 10:09:40,022 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6552cd4e72d5ca6219b168bcf32684a in 849ms, sequenceid=41, compaction requested=true 2023-02-13 10:09:40,023 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:40,023 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:40,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:09:40,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:09:40,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 10:09:40,023 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 10:09:40,054 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,054 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:40,055 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,055 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:40,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 10:09:40,057 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 10:09:40,057 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b9f42fc[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:40,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,063 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 10:09:40,063 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,063 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:40,063 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 10:09:40,063 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:40,071 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 10:09:40,071 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:40,071 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 10:09:40,071 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:40,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 10:09:40,074 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 10:09:40,074 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:40,074 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:40,074 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,074 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:40,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:40,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:40,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,080 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:40,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:40,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:40,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,081 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:40,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,088 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 10:09:40,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:40,088 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:40,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 10:09:40,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:40,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:40,089 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:40,089 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:40,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:40,189 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:40,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:40,192 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:40,193 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:40,194 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:40,195 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:40,195 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283580195 2023-02-13 10:09:40,198 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:40,199 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 10:09:40,199 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:40,200 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x2074e907 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:40,213 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213642e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:40,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,084 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103de34f2068366414fbb67538990c96693 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103de34f2068366414fbb67538990c96693 2023-02-13 10:09:41,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:41,102 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:41,103 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:55988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:41,111 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:41,112 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:41,120 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/be72b488a4f3493aa3b6624c71012e4a first=Optional[r3] last=Optional[r6] 2023-02-13 10:09:41,120 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/be72b488a4f3493aa3b6624c71012e4a}] 2023-02-13 10:09:41,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/be72b488a4f3493aa3b6624c71012e4a for inclusion in c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 10:09:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/be72b488a4f3493aa3b6624c71012e4a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jdpl7ei3bftiq4oeu91i4npfcsg0h3ug3eispee6bstr3r49d74cdj9qrt3o5tqp/family1/be72b488a4f3493aa3b6624c71012e4a 2023-02-13 10:09:41,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jdpl7ei3bftiq4oeu91i4npfcsg0h3ug3eispee6bstr3r49d74cdj9qrt3o5tqp/family1/be72b488a4f3493aa3b6624c71012e4a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_ 2023-02-13 10:09:41,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jdpl7ei3bftiq4oeu91i4npfcsg0h3ug3eispee6bstr3r49d74cdj9qrt3o5tqp/family1/be72b488a4f3493aa3b6624c71012e4a into c6552cd4e72d5ca6219b168bcf32684a/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_ - updating store file list. 2023-02-13 10:09:41,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_ into c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:41,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jdpl7ei3bftiq4oeu91i4npfcsg0h3ug3eispee6bstr3r49d74cdj9qrt3o5tqp/family1/be72b488a4f3493aa3b6624c71012e4a into c6552cd4e72d5ca6219b168bcf32684a/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_) 2023-02-13 10:09:41,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jdpl7ei3bftiq4oeu91i4npfcsg0h3ug3eispee6bstr3r49d74cdj9qrt3o5tqp/family1/be72b488a4f3493aa3b6624c71012e4a 2023-02-13 10:09:41,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:09:41,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:09:41,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): c6552cd4e72d5ca6219b168bcf32684a/family1 is initiating minor compaction 2023-02-13 10:09:41,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@11ae3e8e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:41,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c6552cd4e72d5ca6219b168bcf32684a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:41,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp, totalSize=50.3 K 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting bb9c1bcbd30347e58b9bcda19b959069, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 223b8ba08c9448a1a3b17757628b4c56, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 16c6bdfe700e4360a13a280651c51dd6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting a59b5fe1392649a489b8a0101c85c30c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 5a159f5cf3d24c879f7bf840a0ff4e43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 5ae020ba39e84f0ea6cb16a0f1d74b2b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:09:41,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting dfea74cdeefd4028b67cb8126f298175, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:09:41,141 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting b7c108d7668e4baa9c1cf3fa8aa399d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:09:41,141 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 5cad4657a1c046b9bf325869fb2d3c13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:09:41,141 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 2f86c9c2872e4f9189d6867f848140ca_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:09:41,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:41,143 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:41,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122804b0e0f6d699426f8103d9e585951b63 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122804b0e0f6d699426f8103d9e585951b63 2023-02-13 10:09:41,145 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a27142fc33764e6b8ae82d9362e56546 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a27142fc33764e6b8ae82d9362e56546 2023-02-13 10:09:41,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601015de6f4db04aa454eaef33fa96651cd4d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601015de6f4db04aa454eaef33fa96651cd4d 2023-02-13 10:09:41,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010315b7e0e54138426b9979dcd6e30e3349 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010315b7e0e54138426b9979dcd6e30e3349 2023-02-13 10:09:41,147 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-13 10:09:41,147 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:41,163 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): c6552cd4e72d5ca6219b168bcf32684a#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:41,987 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054a6706318ddd43349fbc26f98db416b6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054a6706318ddd43349fbc26f98db416b6 2023-02-13 10:09:41,988 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/3483bf0a07054e0cbdf10472839d033d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/3483bf0a07054e0cbdf10472839d033d 2023-02-13 10:09:41,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:41,991 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c6552cd4e72d5ca6219b168bcf32684a/family1 of c6552cd4e72d5ca6219b168bcf32684a into 3483bf0a07054e0cbdf10472839d033d(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:09:41,991 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:41,991 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676282981139; duration=0sec 2023-02-13 10:09:41,992 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:42,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_] to archive 2023-02-13 10:09:42,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:42,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/bb9c1bcbd30347e58b9bcda19b959069 2023-02-13 10:09:42,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/223b8ba08c9448a1a3b17757628b4c56 2023-02-13 10:09:42,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/16c6bdfe700e4360a13a280651c51dd6 2023-02-13 10:09:42,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/a59b5fe1392649a489b8a0101c85c30c 2023-02-13 10:09:42,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5a159f5cf3d24c879f7bf840a0ff4e43 2023-02-13 10:09:42,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5ae020ba39e84f0ea6cb16a0f1d74b2b 2023-02-13 10:09:42,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/dfea74cdeefd4028b67cb8126f298175 2023-02-13 10:09:42,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/b7c108d7668e4baa9c1cf3fa8aa399d4 2023-02-13 10:09:42,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/5cad4657a1c046b9bf325869fb2d3c13 2023-02-13 10:09:42,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/2f86c9c2872e4f9189d6867f848140ca_SeqId_44_ 2023-02-13 10:09:42,018 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/13b72861aac24ac18222ab11337b7854 first=Optional[r00] last=Optional[r2] 2023-02-13 10:09:42,018 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/13b72861aac24ac18222ab11337b7854}] 2023-02-13 10:09:42,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/13b72861aac24ac18222ab11337b7854 for inclusion in c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:42,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 10:09:42,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:42,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:42,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/13b72861aac24ac18222ab11337b7854 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g33na9kr7npoki388od0ng2c0siib921u034u943b71d1vl4cdhr92erl5s27h7p/family1/13b72861aac24ac18222ab11337b7854 2023-02-13 10:09:42,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g33na9kr7npoki388od0ng2c0siib921u034u943b71d1vl4cdhr92erl5s27h7p/family1/13b72861aac24ac18222ab11337b7854 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_ 2023-02-13 10:09:42,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g33na9kr7npoki388od0ng2c0siib921u034u943b71d1vl4cdhr92erl5s27h7p/family1/13b72861aac24ac18222ab11337b7854 into c6552cd4e72d5ca6219b168bcf32684a/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_ - updating store file list. 2023-02-13 10:09:42,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_ into c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:42,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g33na9kr7npoki388od0ng2c0siib921u034u943b71d1vl4cdhr92erl5s27h7p/family1/13b72861aac24ac18222ab11337b7854 into c6552cd4e72d5ca6219b168bcf32684a/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_) 2023-02-13 10:09:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g33na9kr7npoki388od0ng2c0siib921u034u943b71d1vl4cdhr92erl5s27h7p/family1/13b72861aac24ac18222ab11337b7854 2023-02-13 10:09:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:09:42,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:09:42,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): c6552cd4e72d5ca6219b168bcf32684a/family1 is initiating minor compaction (all files) 2023-02-13 10:09:42,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ef6ddb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:42,032 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c6552cd4e72d5ca6219b168bcf32684a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:42,032 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/3483bf0a07054e0cbdf10472839d033d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp, totalSize=388.1 K 2023-02-13 10:09:42,032 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting eb27b54665654da985bd4a440148f871, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:09:42,033 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 3483bf0a07054e0cbdf10472839d033d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:09:42,033 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting ceda1ebdfab445c3aacca2428073ed36_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806172 2023-02-13 10:09:42,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:42,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:42,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d834f521e2024d6c859c7d245e0ed6d7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d834f521e2024d6c859c7d245e0ed6d7 2023-02-13 10:09:42,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a8e405a03ed84dbb82a8e9b03459b30a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a8e405a03ed84dbb82a8e9b03459b30a 2023-02-13 10:09:42,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120542b41c9e630e4872ab00f696f92c3e44 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120542b41c9e630e4872ab00f696f92c3e44 2023-02-13 10:09:42,037 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-13 10:09:42,037 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 10:09:42,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:42,038 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:42,038 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:42,039 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:42,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8470 sec 2023-02-13 10:09:42,048 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): c6552cd4e72d5ca6219b168bcf32684a#family1#compaction#74 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:42,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 10:09:42,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:42,525 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:42,528 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:42,528 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:42,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 10:09:42,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE}] 2023-02-13 10:09:42,538 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE 2023-02-13 10:09:42,539 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:42,540 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282982539"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282982539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282982539"}]},"ts":"1676282982539"} 2023-02-13 10:09:42,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:42,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:42,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing c6552cd4e72d5ca6219b168bcf32684a, disabling compactions & flushes 2023-02-13 10:09:42,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,280 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/.tmp/family1/fc9c908ce478452c87dc26a1b497479f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/fc9c908ce478452c87dc26a1b497479f 2023-02-13 10:09:43,287 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c6552cd4e72d5ca6219b168bcf32684a/family1 of c6552cd4e72d5ca6219b168bcf32684a into fc9c908ce478452c87dc26a1b497479f(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:09:43,288 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:43,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,288 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676282982032; duration=1sec 2023-02-13 10:09:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. after waiting 0 ms 2023-02-13 10:09:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,288 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:43,290 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/3483bf0a07054e0cbdf10472839d033d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_] to archive 2023-02-13 10:09:43,291 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:43,293 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/eb27b54665654da985bd4a440148f871 2023-02-13 10:09:43,294 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/3483bf0a07054e0cbdf10472839d033d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/3483bf0a07054e0cbdf10472839d033d 2023-02-13 10:09:43,295 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/ceda1ebdfab445c3aacca2428073ed36_SeqId_47_ 2023-02-13 10:09:43,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 10:09:43,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for c6552cd4e72d5ca6219b168bcf32684a: Waiting for close lock at 1676282982695Running coprocessor pre-close hooks at 1676282982695Disabling compacts and flushes for region at 1676282982695Disabling writes for close at 1676282983288 (+593 ms)Writing region close event to WAL at 1676282983296 (+8 ms)Running coprocessor post-close hooks at 1676282983300 (+4 ms)Closed at 1676282983300 2023-02-13 10:09:43,301 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c6552cd4e72d5ca6219b168bcf32684a to self. 2023-02-13 10:09:43,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,302 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=CLOSED 2023-02-13 10:09:43,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282983302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282983302"}]},"ts":"1676282983302"} 2023-02-13 10:09:43,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-13 10:09:43,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 762 msec 2023-02-13 10:09:43,306 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=true 2023-02-13 10:09:43,456 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:43,457 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282983456"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282983456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282983456"}]},"ts":"1676282983456"} 2023-02-13 10:09:43,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:43,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c6552cd4e72d5ca6219b168bcf32684a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:43,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:43,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,624 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,626 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:43,626 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:43,626 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6552cd4e72d5ca6219b168bcf32684a columnFamilyName family1 2023-02-13 10:09:43,631 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/fc9c908ce478452c87dc26a1b497479f 2023-02-13 10:09:43,631 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(310): Store=c6552cd4e72d5ca6219b168bcf32684a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:43,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:43,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened c6552cd4e72d5ca6219b168bcf32684a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61517780, jitterRate=-0.08331364393234253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:43,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for c6552cd4e72d5ca6219b168bcf32684a: Running coprocessor pre-open hook at 1676282983621Writing region info on filesystem at 1676282983621Initializing all the Stores at 1676282983623 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676282983623Cleaning up temporary data from old regions at 1676282983634 (+11 ms)Cleaning up detritus from prior splits at 1676282983634Running coprocessor post-open hooks at 1676282983636 (+2 ms)Region opened successfully at 1676282983636 2023-02-13 10:09:43,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., pid=63, masterSystemTime=1676282983612 2023-02-13 10:09:43,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:43,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:43,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282983638"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282983638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282983638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282983638"}]},"ts":"1676282983638"} 2023-02-13 10:09:43,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-13 10:09:43,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 180 msec 2023-02-13 10:09:43,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-13 10:09:43,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE in 1.1030 sec 2023-02-13 10:09:43,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-13 10:09:43,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1100 sec 2023-02-13 10:09:43,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5300 sec 2023-02-13 10:09:43,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-13 10:09:43,647 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(278): alter status finished 2023-02-13 10:09:43,648 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:43,649 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:43,650 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:43,650 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283583650 2023-02-13 10:09:43,650 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:43,651 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:43,652 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 10:09:43,652 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:43,652 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x44d30b7b to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:43,731 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75df28ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:43,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:43,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:43,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:43,732 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:43,732 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:44,171 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b89047877f0c46d293f0e2245ba623ad to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128b89047877f0c46d293f0e2245ba623ad 2023-02-13 10:09:44,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:44,186 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:44,187 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:55998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:44,192 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:44,194 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:44,203 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/684593c6dad94e32989ce5ad851e4252 first=Optional[r05] last=Optional[r8] 2023-02-13 10:09:44,203 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/684593c6dad94e32989ce5ad851e4252}] 2023-02-13 10:09:44,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/684593c6dad94e32989ce5ad851e4252 for inclusion in c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:44,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 10:09:44,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:44,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for c6552cd4e72d5ca6219b168bcf32684a: 2023-02-13 10:09:44,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/684593c6dad94e32989ce5ad851e4252 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__37irvcct50tln5hjushcej50tdkap7k54trc80hvnpqq9qinqgb8k3r791j866ci/family1/684593c6dad94e32989ce5ad851e4252 2023-02-13 10:09:44,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__37irvcct50tln5hjushcej50tdkap7k54trc80hvnpqq9qinqgb8k3r791j866ci/family1/684593c6dad94e32989ce5ad851e4252 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/f7c9ea65191f454da14d7146798fc9be_SeqId_53_ 2023-02-13 10:09:44,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__37irvcct50tln5hjushcej50tdkap7k54trc80hvnpqq9qinqgb8k3r791j866ci/family1/684593c6dad94e32989ce5ad851e4252 into c6552cd4e72d5ca6219b168bcf32684a/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/f7c9ea65191f454da14d7146798fc9be_SeqId_53_ - updating store file list. 2023-02-13 10:09:44,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/f7c9ea65191f454da14d7146798fc9be_SeqId_53_ into c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:44,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__37irvcct50tln5hjushcej50tdkap7k54trc80hvnpqq9qinqgb8k3r791j866ci/family1/684593c6dad94e32989ce5ad851e4252 into c6552cd4e72d5ca6219b168bcf32684a/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/f7c9ea65191f454da14d7146798fc9be_SeqId_53_) 2023-02-13 10:09:44,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__37irvcct50tln5hjushcej50tdkap7k54trc80hvnpqq9qinqgb8k3r791j866ci/family1/684593c6dad94e32989ce5ad851e4252 2023-02-13 10:09:44,218 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:44,219 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:44,220 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112069a290ea9e964203a3e3dbd5c9b496a3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112069a290ea9e964203a3e3dbd5c9b496a3 2023-02-13 10:09:44,221 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286040b7e221fe4e9da3f63535f8ba2d39 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286040b7e221fe4e9da3f63535f8ba2d39 2023-02-13 10:09:44,221 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-13 10:09:44,221 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 10:09:44,221 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:44,221 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:44,221 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:44,221 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:44,221 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:44,222 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:44,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 574 msec 2023-02-13 10:09:44,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-13 10:09:44,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:44,692 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 10:09:44,695 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 10:09:44,695 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 10:09:44,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 10:09:44,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE}] 2023-02-13 10:09:44,704 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE 2023-02-13 10:09:44,705 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:44,705 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282984705"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282984705"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282984705"}]},"ts":"1676282984705"} 2023-02-13 10:09:44,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:44,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:44,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing c6552cd4e72d5ca6219b168bcf32684a, disabling compactions & flushes 2023-02-13 10:09:44,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:44,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:44,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. after waiting 0 ms 2023-02-13 10:09:44,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:44,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 10:09:44,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:44,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for c6552cd4e72d5ca6219b168bcf32684a: Waiting for close lock at 1676282984859Running coprocessor pre-close hooks at 1676282984859Disabling compacts and flushes for region at 1676282984859Disabling writes for close at 1676282984860 (+1 ms)Writing region close event to WAL at 1676282984871 (+11 ms)Running coprocessor post-close hooks at 1676282984875 (+4 ms)Closed at 1676282984875 2023-02-13 10:09:44,875 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c6552cd4e72d5ca6219b168bcf32684a to self. 2023-02-13 10:09:44,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:44,876 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=CLOSED 2023-02-13 10:09:44,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282984876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282984876"}]},"ts":"1676282984876"} 2023-02-13 10:09:44,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-13 10:09:44,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 170 msec 2023-02-13 10:09:44,879 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=true 2023-02-13 10:09:45,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:45,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282985029"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282985029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282985029"}]},"ts":"1676282985029"} 2023-02-13 10:09:45,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:45,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:45,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c6552cd4e72d5ca6219b168bcf32684a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:45,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:45,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,193 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,194 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:45,194 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1 2023-02-13 10:09:45,194 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6552cd4e72d5ca6219b168bcf32684a columnFamilyName family1 2023-02-13 10:09:45,201 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/f7c9ea65191f454da14d7146798fc9be_SeqId_53_ 2023-02-13 10:09:45,206 DEBUG [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/family1/fc9c908ce478452c87dc26a1b497479f 2023-02-13 10:09:45,207 INFO [StoreOpener-c6552cd4e72d5ca6219b168bcf32684a-1] regionserver.HStore(310): Store=c6552cd4e72d5ca6219b168bcf32684a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:45,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:09:45,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened c6552cd4e72d5ca6219b168bcf32684a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67367599, jitterRate=0.0038554519414901733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:45,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for c6552cd4e72d5ca6219b168bcf32684a: Running coprocessor pre-open hook at 1676282985190Writing region info on filesystem at 1676282985190Initializing all the Stores at 1676282985192 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676282985192Cleaning up temporary data from old regions at 1676282985209 (+17 ms)Cleaning up detritus from prior splits at 1676282985210 (+1 ms)Running coprocessor post-open hooks at 1676282985212 (+2 ms)Region opened successfully at 1676282985212 2023-02-13 10:09:45,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a., pid=69, masterSystemTime=1676282985184 2023-02-13 10:09:45,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:45,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:09:45,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c6552cd4e72d5ca6219b168bcf32684a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:45,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676282985214"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282985214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282985214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282985214"}]},"ts":"1676282985214"} 2023-02-13 10:09:45,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-13 10:09:45,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure c6552cd4e72d5ca6219b168bcf32684a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 184 msec 2023-02-13 10:09:45,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-13 10:09:45,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c6552cd4e72d5ca6219b168bcf32684a, REOPEN/MOVE in 513 msec 2023-02-13 10:09:45,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-13 10:09:45,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 519 msec 2023-02-13 10:09:45,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 939 msec 2023-02-13 10:09:45,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-13 10:09:45,222 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(278): alter status finished 2023-02-13 10:09:45,222 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 10:09:45,223 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:45,224 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:45,225 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:45,225 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283585225 2023-02-13 10:09:45,225 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:09:45,226 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 10:09:45,226 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:45,226 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x22d3a46e to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:45,263 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37c4520, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 10:09:45,264 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 10:09:45,264 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:45,265 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 10:09:45,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 42 msec 2023-02-13 10:09:45,320 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248 (was 240) - Thread LEAK? -, OpenFileDescriptor=633 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 144) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=7816 (was 7824) 2023-02-13 10:09:45,329 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=248, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=165, AvailableMemoryMB=7815 2023-02-13 10:09:45,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 10:09:45,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:45,334 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:09:45,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-13 10:09:45,335 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:09:45,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:45,336 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:45,336 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 empty. 2023-02-13 10:09:45,336 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:45,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 10:09:45,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:45,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:45,745 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:45,747 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => e4ccc9446726faa57c0bfc5d4f9f3a03, NAME => 'testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:45,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:46,157 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:46,158 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing e4ccc9446726faa57c0bfc5d4f9f3a03, disabling compactions & flushes 2023-02-13 10:09:46,158 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,158 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,158 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. after waiting 0 ms 2023-02-13 10:09:46,158 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,158 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,159 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for e4ccc9446726faa57c0bfc5d4f9f3a03: Waiting for close lock at 1676282986158Disabling compacts and flushes for region at 1676282986158Disabling writes for close at 1676282986158Writing region close event to WAL at 1676282986158Closed at 1676282986158 2023-02-13 10:09:46,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:09:46,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676282986179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282986179"}]},"ts":"1676282986179"} 2023-02-13 10:09:46,182 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:09:46,184 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:09:46,184 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282986184"}]},"ts":"1676282986184"} 2023-02-13 10:09:46,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-13 10:09:46,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, ASSIGN}] 2023-02-13 10:09:46,223 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, ASSIGN 2023-02-13 10:09:46,224 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:46,375 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e4ccc9446726faa57c0bfc5d4f9f3a03, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:46,375 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676282986375"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282986375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282986375"}]},"ts":"1676282986375"} 2023-02-13 10:09:46,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure e4ccc9446726faa57c0bfc5d4f9f3a03, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:46,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4ccc9446726faa57c0bfc5d4f9f3a03, NAME => 'testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:09:46,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-13 10:09:46,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-13 10:09:46,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:46,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,546 INFO [StoreOpener-e4ccc9446726faa57c0bfc5d4f9f3a03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,547 DEBUG [StoreOpener-e4ccc9446726faa57c0bfc5d4f9f3a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1 2023-02-13 10:09:46,547 DEBUG [StoreOpener-e4ccc9446726faa57c0bfc5d4f9f3a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1 2023-02-13 10:09:46,548 INFO [StoreOpener-e4ccc9446726faa57c0bfc5d4f9f3a03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4ccc9446726faa57c0bfc5d4f9f3a03 columnFamilyName f1 2023-02-13 10:09:46,549 INFO [StoreOpener-e4ccc9446726faa57c0bfc5d4f9f3a03-1] regionserver.HStore(310): Store=e4ccc9446726faa57c0bfc5d4f9f3a03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:46,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:46,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:46,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened e4ccc9446726faa57c0bfc5d4f9f3a03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65625568, jitterRate=-0.022102832794189453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:09:46,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for e4ccc9446726faa57c0bfc5d4f9f3a03: Running coprocessor pre-open hook at 1676282986543Writing region info on filesystem at 1676282986543Initializing all the Stores at 1676282986545 (+2 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282986545Cleaning up temporary data from old regions at 1676282986550 (+5 ms)Cleaning up detritus from prior splits at 1676282986550Running coprocessor post-open hooks at 1676282986553 (+3 ms)Region opened successfully at 1676282986553 2023-02-13 10:09:46,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03., pid=73, masterSystemTime=1676282986531 2023-02-13 10:09:46,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:46,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e4ccc9446726faa57c0bfc5d4f9f3a03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:46,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676282986555"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282986555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282986555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282986555"}]},"ts":"1676282986555"} 2023-02-13 10:09:46,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-13 10:09:46,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure e4ccc9446726faa57c0bfc5d4f9f3a03, server=jenkins-hbase16.apache.org,38311,1676282881622 in 178 msec 2023-02-13 10:09:46,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-13 10:09:46,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, ASSIGN in 336 msec 2023-02-13 10:09:46,559 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:09:46,559 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282986559"}]},"ts":"1676282986559"} 2023-02-13 10:09:46,559 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-13 10:09:46,570 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:09:46,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.2380 sec 2023-02-13 10:09:47,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 10:09:47,444 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-13 10:09:47,444 DEBUG [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-13 10:09:47,448 INFO [Listener at localhost.localdomain/39579] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 10:09:47,453 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-13 10:09:47,453 INFO [Listener at localhost.localdomain/39579] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 10:09:47,454 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-13 10:09:47,459 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2744): Flushing e4ccc9446726faa57c0bfc5d4f9f3a03 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 10:09:47,879 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213e49531ae430748cd955a5eff6974caa4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213e49531ae430748cd955a5eff6974caa4 2023-02-13 10:09:48,287 INFO [Listener at localhost.localdomain/39579] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp/f1/52335fd78d90418d8f7af605d64655a2 2023-02-13 10:09:48,299 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp/f1/52335fd78d90418d8f7af605d64655a2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2 2023-02-13 10:09:48,305 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 10:09:48,306 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for e4ccc9446726faa57c0bfc5d4f9f3a03 in 847ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:48,306 DEBUG [Listener at localhost.localdomain/39579] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-13 10:09:48,307 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2445): Flush status journal for e4ccc9446726faa57c0bfc5d4f9f3a03: 2023-02-13 10:09:48,309 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2744): Flushing e4ccc9446726faa57c0bfc5d4f9f3a03 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 10:09:48,724 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021342f3bb5fc55548ceae8d5741ad1de00e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021342f3bb5fc55548ceae8d5741ad1de00e 2023-02-13 10:09:48,836 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:09:49,131 INFO [Listener at localhost.localdomain/39579] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp/f1/affc77028eb14244a32c4bac5fcc0d5d 2023-02-13 10:09:49,135 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp/f1/affc77028eb14244a32c4bac5fcc0d5d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d 2023-02-13 10:09:49,138 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d, entries=1, sequenceid=9, filesize=4.9 K 2023-02-13 10:09:49,139 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for e4ccc9446726faa57c0bfc5d4f9f3a03 in 830ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:49,139 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2445): Flush status journal for e4ccc9446726faa57c0bfc5d4f9f3a03: 2023-02-13 10:09:49,141 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-13 10:09:49,142 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 10:09:49,142 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 10:09:49,143 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283589143 2023-02-13 10:09:49,143 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:49,143 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:09:49,144 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-13 10:09:49,144 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-13 10:09:49,144 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x17f99395 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:09:49,192 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,192 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,239 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@764d810f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:09:49,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 10:09:49,243 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,244 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,294 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,295 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,345 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,345 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,396 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,396 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,447 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,447 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,498 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,498 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,549 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,549 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,600 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,600 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,651 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,651 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,702 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,702 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,753 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,753 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,804 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,805 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,856 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,856 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,907 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,908 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,959 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:49,959 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,011 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,011 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,063 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,063 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,084 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136e6fafa1697e484fb80646b8b6984711 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302136e6fafa1697e484fb80646b8b6984711 2023-02-13 10:09:50,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 10:09:50,099 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:09:50,100 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:09:50,106 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:09:50,108 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:51528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:09:50,114 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,114 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,117 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b1e9ef00b30940f894e337190a8bea51 first=Optional[r1] last=Optional[r2] 2023-02-13 10:09:50,117 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b1e9ef00b30940f894e337190a8bea51}] 2023-02-13 10:09:50,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b1e9ef00b30940f894e337190a8bea51 for inclusion in e4ccc9446726faa57c0bfc5d4f9f3a03/f1 2023-02-13 10:09:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 10:09:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:09:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for e4ccc9446726faa57c0bfc5d4f9f3a03: 2023-02-13 10:09:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b1e9ef00b30940f894e337190a8bea51 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testGetAfterCompaction__13a38dqflr55alufvhgc5ps05ghhg65gnuhjf1mqpurn9dlcs33509u6folrkliv/f1/b1e9ef00b30940f894e337190a8bea51 2023-02-13 10:09:50,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testGetAfterCompaction__13a38dqflr55alufvhgc5ps05ghhg65gnuhjf1mqpurn9dlcs33509u6folrkliv/f1/b1e9ef00b30940f894e337190a8bea51 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_ 2023-02-13 10:09:50,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testGetAfterCompaction__13a38dqflr55alufvhgc5ps05ghhg65gnuhjf1mqpurn9dlcs33509u6folrkliv/f1/b1e9ef00b30940f894e337190a8bea51 into e4ccc9446726faa57c0bfc5d4f9f3a03/f1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_ - updating store file list. 2023-02-13 10:09:50,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_ into e4ccc9446726faa57c0bfc5d4f9f3a03/f1 2023-02-13 10:09:50,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testGetAfterCompaction__13a38dqflr55alufvhgc5ps05ghhg65gnuhjf1mqpurn9dlcs33509u6folrkliv/f1/b1e9ef00b30940f894e337190a8bea51 into e4ccc9446726faa57c0bfc5d4f9f3a03/f1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_) 2023-02-13 10:09:50,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testGetAfterCompaction__13a38dqflr55alufvhgc5ps05ghhg65gnuhjf1mqpurn9dlcs33509u6folrkliv/f1/b1e9ef00b30940f894e337190a8bea51 2023-02-13 10:09:50,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(1912): e4ccc9446726faa57c0bfc5d4f9f3a03/f1 is initiating minor compaction 2023-02-13 10:09:50,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d8655fc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:50,131 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e4ccc9446726faa57c0bfc5d4f9f3a03/f1 in testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:50,131 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp, totalSize=10.0 K 2023-02-13 10:09:50,131 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting affc77028eb14244a32c4bac5fcc0d5d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:09:50,131 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 9eb52d7390614fd6a1e820605d3336ea_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:09:50,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 10:09:50,134 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:50,135 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021342f3bb5fc55548ceae8d5741ad1de00e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021342f3bb5fc55548ceae8d5741ad1de00e 2023-02-13 10:09:50,136 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213e49531ae430748cd955a5eff6974caa4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213e49531ae430748cd955a5eff6974caa4 2023-02-13 10:09:50,136 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-13 10:09:50,136 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 10:09:50,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 10:09:50,136 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-13 10:09:50,136 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:09:50,137 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 10:09:50,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 996 msec 2023-02-13 10:09:50,139 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): e4ccc9446726faa57c0bfc5d4f9f3a03#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-13 10:09:50,165 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,165 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,166 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,172 DEBUG [Listener at localhost.localdomain/39579] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 10:09:50,177 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 10:09:50,177 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38311] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:50,178 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-13 10:09:50,178 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 10:09:50,178 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38311] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 10:09:50,178 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38311] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. because compaction request was cancelled 2023-02-13 10:09:50,230 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,230 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,230 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,268 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 10:09:50,268 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-13 10:09:50,281 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,282 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,282 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,333 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,333 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,333 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,385 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,385 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,385 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,437 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,437 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,437 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,489 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,489 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,489 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,541 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,541 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,541 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,592 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,593 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,593 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,644 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,644 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,644 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,695 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,696 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,696 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,747 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,748 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,748 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,799 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,800 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,800 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,851 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,852 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,852 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,904 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,904 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,904 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,956 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,956 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676282990073; access_time=1676282989262; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 10:09:50,957 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282989130; access_time=1676282988311; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:50,967 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/.tmp/f1/675d9d07e5424ebcaa7233e68d7ee181 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/675d9d07e5424ebcaa7233e68d7ee181 2023-02-13 10:09:50,974 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in e4ccc9446726faa57c0bfc5d4f9f3a03/f1 of e4ccc9446726faa57c0bfc5d4f9f3a03 into 675d9d07e5424ebcaa7233e68d7ee181(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:09:50,974 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e4ccc9446726faa57c0bfc5d4f9f3a03: 2023-02-13 10:09:50,974 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676282990131; duration=0sec 2023-02-13 10:09:50,974 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:09:50,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_] to archive 2023-02-13 10:09:50,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:09:50,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/affc77028eb14244a32c4bac5fcc0d5d 2023-02-13 10:09:50,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/9eb52d7390614fd6a1e820605d3336ea_SeqId_12_ 2023-02-13 10:09:51,007 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676282988286; access_time=1676282987463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:51,008 INFO [Listener at localhost.localdomain/39579] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/675d9d07e5424ebcaa7233e68d7ee181; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676282990955; access_time=1676282990136; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 10:09:51,138 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-13 10:09:51,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$11(2405): Client=jenkins//188.40.62.62 disable testGetAfterCompaction 2023-02-13 10:09:51,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282991148"}]},"ts":"1676282991148"} 2023-02-13 10:09:51,150 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-13 10:09:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 10:09:51,205 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-13 10:09:51,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, UNASSIGN}] 2023-02-13 10:09:51,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, UNASSIGN 2023-02-13 10:09:51,211 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4ccc9446726faa57c0bfc5d4f9f3a03, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:51,212 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676282991211"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282991211"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282991211"}]},"ts":"1676282991211"} 2023-02-13 10:09:51,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure e4ccc9446726faa57c0bfc5d4f9f3a03, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:51,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 10:09:51,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:51,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing e4ccc9446726faa57c0bfc5d4f9f3a03, disabling compactions & flushes 2023-02-13 10:09:51,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:51,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:51,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. after waiting 0 ms 2023-02-13 10:09:51,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:51,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 10:09:51,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 10:09:51,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03. 2023-02-13 10:09:51,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for e4ccc9446726faa57c0bfc5d4f9f3a03: Waiting for close lock at 1676282991367Running coprocessor pre-close hooks at 1676282991367Disabling compacts and flushes for region at 1676282991367Disabling writes for close at 1676282991367Writing region close event to WAL at 1676282991368 (+1 ms)Running coprocessor post-close hooks at 1676282991375 (+7 ms)Closed at 1676282991377 (+2 ms) 2023-02-13 10:09:51,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:51,379 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4ccc9446726faa57c0bfc5d4f9f3a03, regionState=CLOSED 2023-02-13 10:09:51,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676282991379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282991379"}]},"ts":"1676282991379"} 2023-02-13 10:09:51,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-13 10:09:51,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure e4ccc9446726faa57c0bfc5d4f9f3a03, server=jenkins-hbase16.apache.org,38311,1676282881622 in 167 msec 2023-02-13 10:09:51,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-13 10:09:51,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4ccc9446726faa57c0bfc5d4f9f3a03, UNASSIGN in 175 msec 2023-02-13 10:09:51,386 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282991386"}]},"ts":"1676282991386"} 2023-02-13 10:09:51,387 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-13 10:09:51,403 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-13 10:09:51,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 261 msec 2023-02-13 10:09:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 10:09:51,453 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-13 10:09:51,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$5(2215): Client=jenkins//188.40.62.62 delete testGetAfterCompaction 2023-02-13 10:09:51,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,468 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,470 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 10:09:51,473 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:51,475 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1, FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/recovered.edits] 2023-02-13 10:09:51,479 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/52335fd78d90418d8f7af605d64655a2 2023-02-13 10:09:51,481 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/675d9d07e5424ebcaa7233e68d7ee181 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/f1/675d9d07e5424ebcaa7233e68d7ee181 2023-02-13 10:09:51,485 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/recovered.edits/15.seqid to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03/recovered.edits/15.seqid 2023-02-13 10:09:51,485 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testGetAfterCompaction/e4ccc9446726faa57c0bfc5d4f9f3a03 2023-02-13 10:09:51,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 10:09:51,486 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 10:09:51,487 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-13 10:09:51,491 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302136e6fafa1697e484fb80646b8b6984711 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302136e6fafa1697e484fb80646b8b6984711 2023-02-13 10:09:51,492 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 10:09:51,495 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,522 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-13 10:09:51,524 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-13 10:09:51,525 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,525 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-13 10:09:51,526 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676282991525"}]},"ts":"9223372036854775807"} 2023-02-13 10:09:51,527 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 10:09:51,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4ccc9446726faa57c0bfc5d4f9f3a03, NAME => 'testGetAfterCompaction,,1676282985332.e4ccc9446726faa57c0bfc5d4f9f3a03.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 10:09:51,527 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-13 10:09:51,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676282991527"}]},"ts":"9223372036854775807"} 2023-02-13 10:09:51,528 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-13 10:09:51,538 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 10:09:51,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 78 msec 2023-02-13 10:09:51,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 10:09:51,572 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-13 10:09:51,586 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=252 (was 248) - Thread LEAK? -, OpenFileDescriptor=637 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 170), ProcessCount=165 (was 165), AvailableMemoryMB=7814 (was 7815) 2023-02-13 10:09:51,595 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=252, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=165, AvailableMemoryMB=7813 2023-02-13 10:09:51,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 10:09:51,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-13 10:09:51,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:09:51,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-13 10:09:51,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:09:51,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 empty. 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 empty. 2023-02-13 10:09:51,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 empty. 2023-02-13 10:09:51,603 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:51,603 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:51,603 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:51,603 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-13 10:09:51,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:51,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:52,015 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 10:09:52,017 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => fb0bfb57d3c4dd764ac4f766a0595ed0, NAME => 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:52,018 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 28631355208dcbda9e47f3d8787b6622, NAME => 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:52,018 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 045f8a90e57c08d60c807c425d886d84, NAME => 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:09:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:52,431 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,432 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 28631355208dcbda9e47f3d8787b6622, disabling compactions & flushes 2023-02-13 10:09:52,432 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,432 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,432 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. after waiting 0 ms 2023-02-13 10:09:52,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,432 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,432 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 045f8a90e57c08d60c807c425d886d84, disabling compactions & flushes 2023-02-13 10:09:52,433 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing fb0bfb57d3c4dd764ac4f766a0595ed0, disabling compactions & flushes 2023-02-13 10:09:52,434 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,433 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. after waiting 0 ms 2023-02-13 10:09:52,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 28631355208dcbda9e47f3d8787b6622: Waiting for close lock at 1676282992432Disabling compacts and flushes for region at 1676282992432Disabling writes for close at 1676282992433 (+1 ms)Writing region close event to WAL at 1676282992433Closed at 1676282992433 2023-02-13 10:09:52,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,435 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,435 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. after waiting 0 ms 2023-02-13 10:09:52,435 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for fb0bfb57d3c4dd764ac4f766a0595ed0: Waiting for close lock at 1676282992433Disabling compacts and flushes for region at 1676282992433Disabling writes for close at 1676282992434 (+1 ms)Writing region close event to WAL at 1676282992435 (+1 ms)Closed at 1676282992435 2023-02-13 10:09:52,435 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,435 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,435 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 045f8a90e57c08d60c807c425d886d84: Waiting for close lock at 1676282992432Disabling compacts and flushes for region at 1676282992432Disabling writes for close at 1676282992435 (+3 ms)Writing region close event to WAL at 1676282992435Closed at 1676282992435 2023-02-13 10:09:52,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:09:52,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282992440"}]},"ts":"1676282992440"} 2023-02-13 10:09:52,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282992440"}]},"ts":"1676282992440"} 2023-02-13 10:09:52,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676282992440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676282992440"}]},"ts":"1676282992440"} 2023-02-13 10:09:52,443 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 10:09:52,443 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:09:52,444 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282992444"}]},"ts":"1676282992444"} 2023-02-13 10:09:52,445 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 10:09:52,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN}] 2023-02-13 10:09:52,493 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN 2023-02-13 10:09:52,494 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN 2023-02-13 10:09:52,494 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN 2023-02-13 10:09:52,495 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:52,495 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:52,495 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:09:52,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,648 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282992648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282992648"}]},"ts":"1676282992648"} 2023-02-13 10:09:52,649 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676282992648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282992648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282992648"}]},"ts":"1676282992648"} 2023-02-13 10:09:52,649 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676282992648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676282992648"}]},"ts":"1676282992648"} 2023-02-13 10:09:52,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:52,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:52,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:09:52,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:52,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28631355208dcbda9e47f3d8787b6622, NAME => 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 10:09:52,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,815 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,818 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:09:52,818 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:09:52,819 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28631355208dcbda9e47f3d8787b6622 columnFamilyName family1 2023-02-13 10:09:52,822 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(310): Store=28631355208dcbda9e47f3d8787b6622/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,822 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,824 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2 2023-02-13 10:09:52,824 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2 2023-02-13 10:09:52,824 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28631355208dcbda9e47f3d8787b6622 columnFamilyName family2 2023-02-13 10:09:52,826 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(310): Store=28631355208dcbda9e47f3d8787b6622/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:09:52,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:09:52,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:52,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 28631355208dcbda9e47f3d8787b6622; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59139409, jitterRate=-0.11875413358211517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:09:52,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 28631355208dcbda9e47f3d8787b6622: Running coprocessor pre-open hook at 1676282992813Writing region info on filesystem at 1676282992813Initializing all the Stores at 1676282992815 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992815Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992815Cleaning up temporary data from old regions at 1676282992827 (+12 ms)Cleaning up detritus from prior splits at 1676282992828 (+1 ms)Running coprocessor post-open hooks at 1676282992831 (+3 ms)Region opened successfully at 1676282992831 2023-02-13 10:09:52,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., pid=85, masterSystemTime=1676282992808 2023-02-13 10:09:52,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:52,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fb0bfb57d3c4dd764ac4f766a0595ed0, NAME => 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 10:09:52,833 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,833 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992833"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282992833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282992833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282992833"}]},"ts":"1676282992833"} 2023-02-13 10:09:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,834 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-13 10:09:52,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622 in 178 msec 2023-02-13 10:09:52,836 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:09:52,836 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:09:52,836 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0bfb57d3c4dd764ac4f766a0595ed0 columnFamilyName family1 2023-02-13 10:09:52,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN in 345 msec 2023-02-13 10:09:52,837 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(310): Store=fb0bfb57d3c4dd764ac4f766a0595ed0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,837 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,838 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2 2023-02-13 10:09:52,838 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2 2023-02-13 10:09:52,838 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0bfb57d3c4dd764ac4f766a0595ed0 columnFamilyName family2 2023-02-13 10:09:52,839 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(310): Store=fb0bfb57d3c4dd764ac4f766a0595ed0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:09:52,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:09:52,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:52,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened fb0bfb57d3c4dd764ac4f766a0595ed0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61132880, jitterRate=-0.08904910087585449}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:09:52,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for fb0bfb57d3c4dd764ac4f766a0595ed0: Running coprocessor pre-open hook at 1676282992833Writing region info on filesystem at 1676282992833Initializing all the Stores at 1676282992834 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992834Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992834Cleaning up temporary data from old regions at 1676282992841 (+7 ms)Cleaning up detritus from prior splits at 1676282992841Running coprocessor post-open hooks at 1676282992844 (+3 ms)Region opened successfully at 1676282992844 2023-02-13 10:09:52,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., pid=83, masterSystemTime=1676282992808 2023-02-13 10:09:52,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:52,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 045f8a90e57c08d60c807c425d886d84, NAME => 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 10:09:52,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:09:52,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676282992845"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282992845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282992845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282992845"}]},"ts":"1676282992845"} 2023-02-13 10:09:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,847 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,848 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:09:52,848 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:09:52,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-13 10:09:52,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622 in 194 msec 2023-02-13 10:09:52,849 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 045f8a90e57c08d60c807c425d886d84 columnFamilyName family1 2023-02-13 10:09:52,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN in 360 msec 2023-02-13 10:09:52,850 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(310): Store=045f8a90e57c08d60c807c425d886d84/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,850 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,851 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2 2023-02-13 10:09:52,851 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2 2023-02-13 10:09:52,852 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 045f8a90e57c08d60c807c425d886d84 columnFamilyName family2 2023-02-13 10:09:52,852 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(310): Store=045f8a90e57c08d60c807c425d886d84/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:09:52,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:09:52,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:09:52,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:09:52,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 045f8a90e57c08d60c807c425d886d84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62998621, jitterRate=-0.06124739348888397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:09:52,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 045f8a90e57c08d60c807c425d886d84: Running coprocessor pre-open hook at 1676282992846Writing region info on filesystem at 1676282992846Initializing all the Stores at 1676282992847 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992847Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676282992847Cleaning up temporary data from old regions at 1676282992855 (+8 ms)Cleaning up detritus from prior splits at 1676282992855Running coprocessor post-open hooks at 1676282992858 (+3 ms)Region opened successfully at 1676282992858 2023-02-13 10:09:52,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., pid=84, masterSystemTime=1676282992808 2023-02-13 10:09:52,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:52,860 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:52,861 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676282992860"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676282992860"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676282992860"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676282992860"}]},"ts":"1676282992860"} 2023-02-13 10:09:52,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-13 10:09:52,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622 in 207 msec 2023-02-13 10:09:52,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-02-13 10:09:52,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN in 375 msec 2023-02-13 10:09:52,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:09:52,864 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676282992864"}]},"ts":"1676282992864"} 2023-02-13 10:09:52,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 10:09:52,897 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:09:52,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2990 sec 2023-02-13 10:09:53,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 10:09:53,709 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-13 10:09:53,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:53,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:53,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:53,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:53,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 10:09:53,733 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 10:09:53,733 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:53,733 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 10:09:53,733 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 10:09:53,733 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:53,733 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:53,762 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:53,762 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:53,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:53,763 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:53,763 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:53,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:53,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 10:09:53,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 10:09:53,765 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 10:09:53,765 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:53,765 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 10:09:53,765 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:53,765 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:09:53,766 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 045f8a90e57c08d60c807c425d886d84 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:09:53,766 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:53,766 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:09:53,767 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:09:53,767 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:53,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:53,767 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 28631355208dcbda9e47f3d8787b6622 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:09:53,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:09:53,768 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fb0bfb57d3c4dd764ac4f766a0595ed0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:09:54,190 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c 2023-02-13 10:09:54,190 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 2023-02-13 10:09:54,191 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 2023-02-13 10:09:54,197 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/1cedc3ebc36b45d6b35dd519fa3beb15 2023-02-13 10:09:54,596 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/25d42fd67a824a47b13c35ffcc6b1db9 2023-02-13 10:09:54,596 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/f25aedfaa2d5472f9e61fd002af594e6 2023-02-13 10:09:54,610 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d 2023-02-13 10:09:55,022 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/a175cd0da074476fa03c05830b5947d2 2023-02-13 10:09:55,029 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8 2023-02-13 10:09:55,030 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47 2023-02-13 10:09:55,050 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:55,050 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cff7f22 to 127.0.0.1:57475 2023-02-13 10:09:55,050 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,050 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:55,050 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34d147a3 to 127.0.0.1:57475 2023-02-13 10:09:55,050 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,050 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/1cedc3ebc36b45d6b35dd519fa3beb15 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15 2023-02-13 10:09:55,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cad2f93 to 127.0.0.1:57475 2023-02-13 10:09:55,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,051 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:55,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2074e907 to 127.0.0.1:57475 2023-02-13 10:09:55,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,051 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:55,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44d30b7b to 127.0.0.1:57475 2023-02-13 10:09:55,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,051 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:09:55,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17f99395 to 127.0.0.1:57475 2023-02-13 10:09:55,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22d3a46e to 127.0.0.1:57475 2023-02-13 10:09:55,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:09:55,056 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:09:55,056 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/a175cd0da074476fa03c05830b5947d2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2 2023-02-13 10:09:55,060 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:09:55,060 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 045f8a90e57c08d60c807c425d886d84 in 1294ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:55,060 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 10:09:55,061 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:09:55,061 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:55,061 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:09:55,456 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/0c4a4a807a7f471c9aacf3413499d973 2023-02-13 10:09:55,458 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/7bc70cba12ff496482c2a71dfe18d637 2023-02-13 10:09:55,465 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/f25aedfaa2d5472f9e61fd002af594e6 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6 2023-02-13 10:09:55,466 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/25d42fd67a824a47b13c35ffcc6b1db9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9 2023-02-13 10:09:55,471 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:09:55,472 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:09:55,472 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/0c4a4a807a7f471c9aacf3413499d973 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973 2023-02-13 10:09:55,473 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/7bc70cba12ff496482c2a71dfe18d637 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637 2023-02-13 10:09:55,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:09:55,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:09:55,478 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 28631355208dcbda9e47f3d8787b6622 in 1711ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:55,479 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:09:55,479 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:09:55,479 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fb0bfb57d3c4dd764ac4f766a0595ed0 in 1711ms, sequenceid=5, compaction requested=false 2023-02-13 10:09:55,479 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:09:55,479 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 10:09:55,479 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 10:09:55,512 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,512 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:55,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,513 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:55,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 10:09:55,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@730bc2c0[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:55,518 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 10:09:55,518 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,529 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 10:09:55,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 10:09:55,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:55,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:55,537 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 10:09:55,538 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:55,538 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 10:09:55,537 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:55,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:55,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:55,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:55,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 10:09:55,542 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 10:09:55,542 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:55,542 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:55,542 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 10:09:55,543 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:55,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:55,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:55,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:55,553 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,554 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:55,562 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:55,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:55,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 10:09:55,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,562 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:55,563 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:55,563 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:55,563 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,563 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:55,663 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:55,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:55,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:55,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:55,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:55,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:55,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:55,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 10:09:55,673 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 10:09:55,674 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:55,674 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 10:09:55,674 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 10:09:55,674 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,674 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:55,679 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,679 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:55,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:55,679 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:55,679 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:55,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:55,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 10:09:55,680 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 10:09:55,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 10:09:55,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 10:09:55,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:55,680 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:55,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:09:55,681 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:55,681 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:09:55,681 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 045f8a90e57c08d60c807c425d886d84 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:09:55,681 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 28631355208dcbda9e47f3d8787b6622 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:09:55,681 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fb0bfb57d3c4dd764ac4f766a0595ed0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:09:56,109 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 2023-02-13 10:09:56,109 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc 2023-02-13 10:09:56,110 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb 2023-02-13 10:09:56,515 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/e58ac7ca88d34bfe8746a2e0e8f9422e 2023-02-13 10:09:56,516 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/005aca765bda4f6ea3b322c68fe31135 2023-02-13 10:09:56,516 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/1f8499c5e37647bdaa200fdb6ec326a5 2023-02-13 10:09:56,881 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:09:56,950 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d 2023-02-13 10:09:56,950 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607 2023-02-13 10:09:56,950 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62 2023-02-13 10:09:57,356 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/26b939721b7f4b358debc749c8a565cf 2023-02-13 10:09:57,357 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/607cc515bf164866939fce9249dd6d3d 2023-02-13 10:09:57,357 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/19e9e626fd444449b10da0f17372ae2b 2023-02-13 10:09:57,367 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/e58ac7ca88d34bfe8746a2e0e8f9422e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e 2023-02-13 10:09:57,367 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/005aca765bda4f6ea3b322c68fe31135 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135 2023-02-13 10:09:57,367 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/1f8499c5e37647bdaa200fdb6ec326a5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5 2023-02-13 10:09:57,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:09:57,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:09:57,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:09:57,371 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/26b939721b7f4b358debc749c8a565cf as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf 2023-02-13 10:09:57,371 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/607cc515bf164866939fce9249dd6d3d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d 2023-02-13 10:09:57,371 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/19e9e626fd444449b10da0f17372ae2b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b 2023-02-13 10:09:57,375 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:09:57,375 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:09:57,375 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 28631355208dcbda9e47f3d8787b6622 in 1694ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:57,375 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 045f8a90e57c08d60c807c425d886d84 in 1694ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:57,375 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:09:57,375 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:09:57,375 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:57,375 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:57,375 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:09:57,375 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:09:57,377 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:09:57,378 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fb0bfb57d3c4dd764ac4f766a0595ed0 in 1697ms, sequenceid=9, compaction requested=false 2023-02-13 10:09:57,378 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:09:57,378 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:57,378 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:09:57,378 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:09:57,378 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,378 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 10:09:57,378 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 10:09:57,412 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,412 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:57,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:57,413 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,413 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:57,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:57,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:57,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:57,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 10:09:57,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54515905[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:57,416 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 10:09:57,417 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,421 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 10:09:57,421 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 10:09:57,421 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:57,421 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,421 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:57,429 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 10:09:57,429 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:57,429 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 10:09:57,429 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:57,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 10:09:57,436 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 10:09:57,436 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:57,436 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:57,436 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 10:09:57,436 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:57,446 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,446 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:57,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,446 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:57,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:57,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:57,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:57,447 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:57,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:57,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:57,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:57,462 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:57,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:57,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 10:09:57,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:57,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:57,462 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,463 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,463 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:57,463 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,463 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:57,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:57,463 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:57,563 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:57,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:57,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:57,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:57,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:57,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:57,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:57,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 10:09:57,578 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 10:09:57,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:57,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 10:09:57,578 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 10:09:57,579 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,579 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:57,587 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,587 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:57,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:57,587 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:57,587 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:57,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:57,589 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 10:09:57,589 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 10:09:57,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 10:09:57,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 10:09:57,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:57,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:57,590 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:09:57,590 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:09:57,590 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fb0bfb57d3c4dd764ac4f766a0595ed0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:09:57,590 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 28631355208dcbda9e47f3d8787b6622 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:09:57,590 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 045f8a90e57c08d60c807c425d886d84 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:09:57,590 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:58,010 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 2023-02-13 10:09:58,010 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 2023-02-13 10:09:58,011 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 2023-02-13 10:09:58,418 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/5f6fd253048c46ea8939151a1493c4b9 2023-02-13 10:09:58,418 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/0151342c142744cbafeedcca88f92fd1 2023-02-13 10:09:58,418 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/4c409857a7c24676a7a960ed242ac1c5 2023-02-13 10:09:58,850 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f 2023-02-13 10:09:58,850 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0 2023-02-13 10:09:58,850 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d 2023-02-13 10:09:59,257 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/85561f5897c248a8bb9d513992fef4e1 2023-02-13 10:09:59,258 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/921b1eeddfb540158b5d07d3e5c4ea80 2023-02-13 10:09:59,258 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/0094f07d0a304d2f809799aaa357f9c4 2023-02-13 10:09:59,267 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/0151342c142744cbafeedcca88f92fd1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1 2023-02-13 10:09:59,267 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/4c409857a7c24676a7a960ed242ac1c5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5 2023-02-13 10:09:59,267 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/5f6fd253048c46ea8939151a1493c4b9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9 2023-02-13 10:09:59,271 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:09:59,272 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:09:59,272 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:09:59,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/921b1eeddfb540158b5d07d3e5c4ea80 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80 2023-02-13 10:09:59,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/85561f5897c248a8bb9d513992fef4e1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1 2023-02-13 10:09:59,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/0094f07d0a304d2f809799aaa357f9c4 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4 2023-02-13 10:09:59,279 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:09:59,279 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:09:59,279 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:09:59,280 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fb0bfb57d3c4dd764ac4f766a0595ed0 in 1690ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:59,280 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 28631355208dcbda9e47f3d8787b6622 in 1690ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:59,280 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 045f8a90e57c08d60c807c425d886d84 in 1690ms, sequenceid=13, compaction requested=true 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:59,280 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 10:09:59,280 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 10:09:59,340 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,340 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:59,341 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,341 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:09:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:59,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 10:09:59,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22254fb3[Count = 0] remaining members to acquire global barrier 2023-02-13 10:09:59,345 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 10:09:59,345 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,354 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,354 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 10:09:59,354 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 10:09:59,354 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:09:59,354 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,354 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:09:59,362 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 10:09:59,362 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:59,362 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,362 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 10:09:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:59,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:59,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:59,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:09:59,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 10:09:59,371 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 10:09:59,371 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:09:59,371 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:09:59,371 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 10:09:59,371 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:09:59,379 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,379 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:09:59,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:09:59,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,379 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:59,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:09:59,379 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:59,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:59,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:09:59,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,381 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:09:59,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:09:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:59,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:59,387 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:09:59,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 10:09:59,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:09:59,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:59,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:59,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 10:09:59,388 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:09:59,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 10:09:59,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:09:59,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:09:59,489 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:09:59,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:09:59,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:59,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:59,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:09:59,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:09:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 10:09:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 10:09:59,500 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 10:09:59,500 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:59,500 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 10:09:59,500 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 10:09:59,500 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,500 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:59,503 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:09:59,503 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:09:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:09:59,504 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:09:59,504 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:09:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:59,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:09:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:09:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:09:59,504 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 10:09:59,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 10:09:59,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 10:09:59,505 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 10:09:59,505 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:09:59,505 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:09:59,505 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:09:59,505 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:09:59,505 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 045f8a90e57c08d60c807c425d886d84 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:09:59,505 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:09:59,505 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 28631355208dcbda9e47f3d8787b6622 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:09:59,505 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fb0bfb57d3c4dd764ac4f766a0595ed0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:09:59,516 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac 2023-02-13 10:09:59,922 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 2023-02-13 10:09:59,924 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 2023-02-13 10:09:59,925 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 2023-02-13 10:10:00,268 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 10:10:00,332 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/07f9ce2cd97948e7b60768422265299b 2023-02-13 10:10:00,333 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/5baee855b9034746a57c384a3932be6d 2023-02-13 10:10:00,343 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc 2023-02-13 10:10:00,353 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715 2023-02-13 10:10:00,749 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/25f1b0e38f51439988a3098f4333e836 2023-02-13 10:10:00,757 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef 2023-02-13 10:10:00,758 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 2023-02-13 10:10:00,758 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/706b7c271c89432eac62b9f57d0a70c4 2023-02-13 10:10:00,763 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:00,763 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/5baee855b9034746a57c384a3932be6d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d 2023-02-13 10:10:00,763 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/25f1b0e38f51439988a3098f4333e836 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836 2023-02-13 10:10:00,766 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:00,767 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:00,767 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 045f8a90e57c08d60c807c425d886d84 in 1262ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:00,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:00,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:00,767 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/706b7c271c89432eac62b9f57d0a70c4 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4 2023-02-13 10:10:00,767 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:00,771 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:00,772 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fb0bfb57d3c4dd764ac4f766a0595ed0 in 1267ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:00,772 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:00,772 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:00,772 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:01,164 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/0b5e3e9688414f478bbc6791e4004619 2023-02-13 10:10:01,175 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/07f9ce2cd97948e7b60768422265299b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b 2023-02-13 10:10:01,181 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:01,182 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/0b5e3e9688414f478bbc6791e4004619 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619 2023-02-13 10:10:01,187 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:01,188 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 28631355208dcbda9e47f3d8787b6622 in 1683ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:01,188 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:01,188 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:01,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:01,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:01,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 10:10:01,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 10:10:01,224 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:01,224 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,225 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:01,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 10:10:01,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53dc71a9[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:01,229 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 10:10:01,229 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,237 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 10:10:01,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 10:10:01,238 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:01,238 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,238 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:01,246 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 10:10:01,246 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:01,246 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,246 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 10:10:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:01,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:01,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 10:10:01,255 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 10:10:01,255 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:01,255 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:01,256 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 10:10:01,256 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:01,262 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,262 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:01,262 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:01,263 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:01,264 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:01,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,270 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,270 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:01,270 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:01,270 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:01,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:01,270 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:01,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 10:10:01,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:01,270 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:01,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 10:10:01,271 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,271 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:01,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:01,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:01,272 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:01,271 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:01,272 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:01,372 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:01,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:01,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1580): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:01,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676283001391 (current time:1676283001391). 2023-02-13 10:10:01,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 10:10:01,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] zookeeper.ReadOnlyZKClient(139): Connect 0x2709ecef to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:01,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a61921a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:01,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:01,411 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:56326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:01,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2709ecef to 127.0.0.1:57475 2023-02-13 10:10:01,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:10:01,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 10:10:01,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:01,422 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:01,423 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676283601423 2023-02-13 10:10:01,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:01,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676283001374 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 10:10:01,424 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:01,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 10:10:01,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-13 10:10:01,426 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 10:10:01,427 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676283601427 2023-02-13 10:10:01,429 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:01,429 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 10:10:01,529 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:01,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:01,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:01,537 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 10:10:01,737 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:01,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:01,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:01,738 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 10:10:01,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676283001374 2023-02-13 10:10:01,837 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676283001374' 2023-02-13 10:10:01,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 10:10:01,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676283001374' starting 'acquire' 2023-02-13 10:10:01,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676283001374', kicking off acquire phase on members. 2023-02-13 10:10:01,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:01,838 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676283001374 2023-02-13 10:10:01,870 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 10:10:01,870 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 10:10:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 10:10:01,871 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,872 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676283001374 2023-02-13 10:10:01,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:01,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 10:10:01,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676283001374 2023-02-13 10:10:01,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676283001374 from table testCompactionWithHFileLink type FLUSH 2023-02-13 10:10:01,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676283001374 2023-02-13 10:10:01,880 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676283001374' with timeout 300000ms 2023-02-13 10:10:01,880 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 10:10:01,880 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676283001374' starting 'acquire' stage 2023-02-13 10:10:01,880 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676283001374' locally acquired 2023-02-13 10:10:01,880 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (snaptb-1676283001374) in zk 2023-02-13 10:10:01,887 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,887 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 10:10:01,887 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,887 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676283001374' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:01,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'snaptb-1676283001374' on coordinator 2023-02-13 10:10:01,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eecb4d0[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:01,890 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676283001374' starting 'in-barrier' execution. 2023-02-13 10:10:01,890 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,895 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:01,895 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676283001374' received 'reached' from coordinator. 2023-02-13 10:10:01,896 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:01,896 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:01,897 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:01,897 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:01,897 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-13 10:10:01,897 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:01,897 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:10:01,898 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:01,900 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.' region-info for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,900 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.' region-info for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,900 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.' region-info for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,908 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 10:10:01,908 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 10:10:01,908 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262] hfiles 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d] hfiles 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b] hfiles 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,911 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4] hfiles 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619] hfiles 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836] hfiles 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,914 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,915 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,915 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836 for snapshot=snaptb-1676283001374 2023-02-13 10:10:01,920 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. completed. 2023-02-13 10:10:01,920 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:01,920 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-13 10:10:02,038 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:02,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:02,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:02,040 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 10:10:02,321 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. completed. 2023-02-13 10:10:02,322 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. completed. 2023-02-13 10:10:02,322 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:02,322 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-13 10:10:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-13 10:10:02,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-13 10:10:02,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676283001374' locally completed 2023-02-13 10:10:02,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676283001374' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:02,353 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676283001374' has notified controller of completion 2023-02-13 10:10:02,353 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:02,353 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676283001374' completed. 2023-02-13 10:10:02,353 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 10:10:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676283001374' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:02,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'snaptb-1676283001374', counting down latch. Waiting for 0 more 2023-02-13 10:10:02,357 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676283001374' execution completed 2023-02-13 10:10:02,357 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:02,357 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:02,358 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676283001374 2023-02-13 10:10:02,358 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676283001374including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 10:10:02,362 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,362 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 10:10:02,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,362 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:02,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 10:10:02,362 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,363 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:02,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676283001374 2023-02-13 10:10:02,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676283001374 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676283001374 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 10:10:02,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 10:10:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 10:10:02,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676283001374 2023-02-13 10:10:02,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676283001374 because node does not exist (not an error) 2023-02-13 10:10:02,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-13 10:10:02,370 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676283001374/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:02,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676283001374 2023-02-13 10:10:02,370 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:02,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-13 10:10:02,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 10:10:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 10:10:02,371 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:02,371 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676283001374 2023-02-13 10:10:02,371 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676283001374 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97] mob files 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c 2023-02-13 10:10:02,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 2023-02-13 10:10:02,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f] mob files 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47 2023-02-13 10:10:02,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715 2023-02-13 10:10:02,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f 2023-02-13 10:10:02,540 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:02,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:02,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:02,543 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 10:10:02,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676283001374 2023-02-13 10:10:02,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/snaptb-1676283001374 2023-02-13 10:10:03,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/snaptb-1676283001374 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/snaptb-1676283001374 2023-02-13 10:10:03,543 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:03,545 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-13 10:10:04,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676283001374 of table testCompactionWithHFileLink completed 2023-02-13 10:10:04,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/snaptb-1676283001374 2023-02-13 10:10:04,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/snaptb-1676283001374 2023-02-13 10:10:04,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676283001374 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676283001423Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676283002783 (+1360 ms)Consolidate snapshot: snaptb-1676283001374 at 1676283002783Loading Region manifests for snaptb-1676283001374 at 1676283002784 (+1 ms)Writing data manifest for snaptb-1676283001374 at 1676283002798 (+14 ms)Verifying snapshot: snaptb-1676283001374 at 1676283003329 (+531 ms)Snapshot snaptb-1676283001374 of table testCompactionWithHFileLink completed at 1676283004179 (+850 ms) 2023-02-13 10:10:04,182 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 10:10:04,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.7580 sec 2023-02-13 10:10:05,546 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:05,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:05,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 10:10:05,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 10:10:05,591 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 10:10:05,591 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:05,591 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 10:10:05,591 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 10:10:05,592 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:05,592 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:05,620 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:05,620 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:05,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:05,621 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:05,621 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:05,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:05,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 10:10:05,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 10:10:05,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 10:10:05,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:05,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 10:10:05,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:05,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:05,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:05,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:05,623 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. started... 2023-02-13 10:10:05,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. started... 2023-02-13 10:10:05,622 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:05,623 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 045f8a90e57c08d60c807c425d886d84 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:05,622 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. started... 2023-02-13 10:10:05,623 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fb0bfb57d3c4dd764ac4f766a0595ed0 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:05,623 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 28631355208dcbda9e47f3d8787b6622 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:05,774 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:10:06,444 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/ab14cfd0079e4568817799d15ddf42f5 2023-02-13 10:10:06,444 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/b51d04a637334c968238302a9bf1cd50 2023-02-13 10:10:06,445 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/369d001e841d4470bf78e9a7d5b7b898 2023-02-13 10:10:06,454 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab14cfd0079e4568817799d15ddf42f5 2023-02-13 10:10:06,454 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b51d04a637334c968238302a9bf1cd50 2023-02-13 10:10:06,454 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 369d001e841d4470bf78e9a7d5b7b898 2023-02-13 10:10:07,280 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/cb785254567c44a5b9e797f3a22c7b95 2023-02-13 10:10:07,282 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/4e0242dc2c284847842f023fa5664cb8 2023-02-13 10:10:07,283 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/e7f46f7244154d5f9446f174003656b6 2023-02-13 10:10:07,291 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb785254567c44a5b9e797f3a22c7b95 2023-02-13 10:10:07,291 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0242dc2c284847842f023fa5664cb8 2023-02-13 10:10:07,291 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7f46f7244154d5f9446f174003656b6 2023-02-13 10:10:07,292 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/b51d04a637334c968238302a9bf1cd50 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50 2023-02-13 10:10:07,292 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/369d001e841d4470bf78e9a7d5b7b898 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898 2023-02-13 10:10:07,292 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/ab14cfd0079e4568817799d15ddf42f5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b51d04a637334c968238302a9bf1cd50 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 369d001e841d4470bf78e9a7d5b7b898 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab14cfd0079e4568817799d15ddf42f5 2023-02-13 10:10:07,295 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,296 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/cb785254567c44a5b9e797f3a22c7b95 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95 2023-02-13 10:10:07,296 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/4e0242dc2c284847842f023fa5664cb8 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8 2023-02-13 10:10:07,296 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/e7f46f7244154d5f9446f174003656b6 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7f46f7244154d5f9446f174003656b6 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0242dc2c284847842f023fa5664cb8 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb785254567c44a5b9e797f3a22c7b95 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,300 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 10:10:07,301 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fb0bfb57d3c4dd764ac4f766a0595ed0 in 1678ms, sequenceid=24, compaction requested=true 2023-02-13 10:10:07,301 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 28631355208dcbda9e47f3d8787b6622 in 1678ms, sequenceid=24, compaction requested=true 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:07,301 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 045f8a90e57c08d60c807c425d886d84 in 1678ms, sequenceid=24, compaction requested=true 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:07,301 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 10:10:07,301 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 10:10:07,358 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,358 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:07,359 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,359 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:07,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 10:10:07,364 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 10:10:07,364 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@202b4379[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:07,379 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,379 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 10:10:07,379 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 10:10:07,379 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:07,380 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,380 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:07,387 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,387 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 10:10:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:07,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:07,387 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:07,388 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 10:10:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:07,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:07,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:07,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 10:10:07,395 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 10:10:07,395 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:07,395 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:07,396 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 10:10:07,396 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:07,404 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,404 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:07,404 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:07,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:07,405 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,408 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 10:10:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:07,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 10:10:07,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:07,420 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:07,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:07,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:07,421 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:07,421 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:07,420 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,421 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 10:10:07,421 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 10:10:07,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 10:10:07,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:07,521 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:07,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:07,524 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:07,525 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 045f8a90e57c08d60c807c425d886d84/family1 is initiating major compaction (all files) 2023-02-13 10:10:07,525 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:07,525 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:07,526 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 045f8a90e57c08d60c807c425d886d84/family1 in testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:07,526 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp, totalSize=26.7 K 2023-02-13 10:10:07,528 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 1cedc3ebc36b45d6b35dd519fa3beb15, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993726 2023-02-13 10:10:07,529 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 1f8499c5e37647bdaa200fdb6ec326a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:07,530 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 4c409857a7c24676a7a960ed242ac1c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997568 2023-02-13 10:10:07,531 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting ae6ed13ecf814d0ea26e0a5bb6b06262, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:07,532 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 369d001e841d4470bf78e9a7d5b7b898, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:07,549 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 045f8a90e57c08d60c807c425d886d84#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:07,961 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del 2023-02-13 10:10:07,961 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del 2023-02-13 10:10:08,793 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c3461efb4e8449cbcf51b6b038a7f98 2023-02-13 10:10:08,794 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/6c3461efb4e8449cbcf51b6b038a7f98 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/6c3461efb4e8449cbcf51b6b038a7f98 2023-02-13 10:10:08,798 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c3461efb4e8449cbcf51b6b038a7f98 2023-02-13 10:10:08,799 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 045f8a90e57c08d60c807c425d886d84/family1 of 045f8a90e57c08d60c807c425d886d84 into 6c3461efb4e8449cbcf51b6b038a7f98(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:08,800 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:08,800 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:08,800 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 045f8a90e57c08d60c807c425d886d84/family2 is initiating major compaction (all files) 2023-02-13 10:10:08,800 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:08,800 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:08,800 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 045f8a90e57c08d60c807c425d886d84/family2 in testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:08,800 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp, totalSize=25.4 K 2023-02-13 10:10:08,801 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting a175cd0da074476fa03c05830b5947d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993726 2023-02-13 10:10:08,801 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 607cc515bf164866939fce9249dd6d3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:08,802 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0094f07d0a304d2f809799aaa357f9c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997568 2023-02-13 10:10:08,802 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 25f1b0e38f51439988a3098f4333e836, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:08,803 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 4e0242dc2c284847842f023fa5664cb8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:08,817 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 045f8a90e57c08d60c807c425d886d84#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:08,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898] to archive 2023-02-13 10:10:08,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:08,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1cedc3ebc36b45d6b35dd519fa3beb15 2023-02-13 10:10:08,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/1f8499c5e37647bdaa200fdb6ec326a5 2023-02-13 10:10:08,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/4c409857a7c24676a7a960ed242ac1c5 2023-02-13 10:10:08,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/ae6ed13ecf814d0ea26e0a5bb6b06262 2023-02-13 10:10:08,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/369d001e841d4470bf78e9a7d5b7b898 2023-02-13 10:10:09,234 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del 2023-02-13 10:10:09,234 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del 2023-02-13 10:10:10,059 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8353f356e42409ab10de1b4fa9283e0 2023-02-13 10:10:10,060 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/d8353f356e42409ab10de1b4fa9283e0 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/d8353f356e42409ab10de1b4fa9283e0 2023-02-13 10:10:10,065 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8353f356e42409ab10de1b4fa9283e0 2023-02-13 10:10:10,066 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 045f8a90e57c08d60c807c425d886d84/family2 of 045f8a90e57c08d60c807c425d886d84 into d8353f356e42409ab10de1b4fa9283e0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:10,066 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:10,066 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:10,066 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 28631355208dcbda9e47f3d8787b6622/family1 is initiating major compaction (all files) 2023-02-13 10:10:10,066 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:10,067 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:10,067 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 28631355208dcbda9e47f3d8787b6622/family1 in testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:10,067 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp, totalSize=26.7 K 2023-02-13 10:10:10,068 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting f25aedfaa2d5472f9e61fd002af594e6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993728 2023-02-13 10:10:10,069 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 005aca765bda4f6ea3b322c68fe31135, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:10,069 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0151342c142744cbafeedcca88f92fd1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997569 2023-02-13 10:10:10,070 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 07f9ce2cd97948e7b60768422265299b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:10,070 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b51d04a637334c968238302a9bf1cd50, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:10,084 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 28631355208dcbda9e47f3d8787b6622#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:10,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8] to archive 2023-02-13 10:10:10,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:10,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/a175cd0da074476fa03c05830b5947d2 2023-02-13 10:10:10,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/607cc515bf164866939fce9249dd6d3d 2023-02-13 10:10:10,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/0094f07d0a304d2f809799aaa357f9c4 2023-02-13 10:10:10,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/25f1b0e38f51439988a3098f4333e836 2023-02-13 10:10:10,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/4e0242dc2c284847842f023fa5664cb8 2023-02-13 10:10:10,501 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del 2023-02-13 10:10:10,501 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del 2023-02-13 10:10:11,335 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a1d78e2542c46deb39f225b74e84ab7 2023-02-13 10:10:11,336 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/2a1d78e2542c46deb39f225b74e84ab7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/2a1d78e2542c46deb39f225b74e84ab7 2023-02-13 10:10:11,340 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a1d78e2542c46deb39f225b74e84ab7 2023-02-13 10:10:11,341 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28631355208dcbda9e47f3d8787b6622/family1 of 28631355208dcbda9e47f3d8787b6622 into 2a1d78e2542c46deb39f225b74e84ab7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:11,341 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:11,341 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:11,342 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 28631355208dcbda9e47f3d8787b6622/family2 is initiating major compaction (all files) 2023-02-13 10:10:11,342 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:11,342 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:11,342 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 28631355208dcbda9e47f3d8787b6622/family2 in testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:11,342 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp, totalSize=25.4 K 2023-02-13 10:10:11,342 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0c4a4a807a7f471c9aacf3413499d973, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993728 2023-02-13 10:10:11,343 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 19e9e626fd444449b10da0f17372ae2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:11,343 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 85561f5897c248a8bb9d513992fef4e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997569 2023-02-13 10:10:11,343 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0b5e3e9688414f478bbc6791e4004619, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:11,344 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting cb785254567c44a5b9e797f3a22c7b95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:11,354 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 28631355208dcbda9e47f3d8787b6622#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:11,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50] to archive 2023-02-13 10:10:11,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:11,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f25aedfaa2d5472f9e61fd002af594e6 2023-02-13 10:10:11,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/005aca765bda4f6ea3b322c68fe31135 2023-02-13 10:10:11,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/0151342c142744cbafeedcca88f92fd1 2023-02-13 10:10:11,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/07f9ce2cd97948e7b60768422265299b 2023-02-13 10:10:11,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/b51d04a637334c968238302a9bf1cd50 2023-02-13 10:10:11,767 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del 2023-02-13 10:10:11,768 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del 2023-02-13 10:10:12,607 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b2a1cfe4e745daa9d7d1ac90dbedd2 2023-02-13 10:10:12,609 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2 2023-02-13 10:10:12,618 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b2a1cfe4e745daa9d7d1ac90dbedd2 2023-02-13 10:10:12,619 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28631355208dcbda9e47f3d8787b6622/family2 of 28631355208dcbda9e47f3d8787b6622 into 46b2a1cfe4e745daa9d7d1ac90dbedd2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:12,620 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:12,620 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:12,620 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): fb0bfb57d3c4dd764ac4f766a0595ed0/family1 is initiating major compaction (all files) 2023-02-13 10:10:12,620 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:12,620 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:12,621 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of fb0bfb57d3c4dd764ac4f766a0595ed0/family1 in testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:12,621 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp, totalSize=26.7 K 2023-02-13 10:10:12,621 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 25d42fd67a824a47b13c35ffcc6b1db9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993724 2023-02-13 10:10:12,621 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting e58ac7ca88d34bfe8746a2e0e8f9422e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995667 2023-02-13 10:10:12,622 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 5f6fd253048c46ea8939151a1493c4b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997567 2023-02-13 10:10:12,622 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 5baee855b9034746a57c384a3932be6d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999494 2023-02-13 10:10:12,623 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting ab14cfd0079e4568817799d15ddf42f5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:12,633 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): fb0bfb57d3c4dd764ac4f766a0595ed0#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:12,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95] to archive 2023-02-13 10:10:12,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:12,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0c4a4a807a7f471c9aacf3413499d973 2023-02-13 10:10:12,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/19e9e626fd444449b10da0f17372ae2b 2023-02-13 10:10:12,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/85561f5897c248a8bb9d513992fef4e1 2023-02-13 10:10:12,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/0b5e3e9688414f478bbc6791e4004619 2023-02-13 10:10:12,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/cb785254567c44a5b9e797f3a22c7b95 2023-02-13 10:10:13,050 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del 2023-02-13 10:10:13,050 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del 2023-02-13 10:10:13,474 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ff03d71149342f69640685553069331 2023-02-13 10:10:13,476 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/3ff03d71149342f69640685553069331 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/3ff03d71149342f69640685553069331 2023-02-13 10:10:13,481 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ff03d71149342f69640685553069331 2023-02-13 10:10:13,482 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fb0bfb57d3c4dd764ac4f766a0595ed0/family1 of fb0bfb57d3c4dd764ac4f766a0595ed0 into 3ff03d71149342f69640685553069331(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:13,482 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:13,482 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:13,482 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): fb0bfb57d3c4dd764ac4f766a0595ed0/family2 is initiating major compaction (all files) 2023-02-13 10:10:13,482 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:13,483 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:13,483 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of fb0bfb57d3c4dd764ac4f766a0595ed0/family2 in testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:13,483 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp, totalSize=25.4 K 2023-02-13 10:10:13,483 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 7bc70cba12ff496482c2a71dfe18d637, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993724 2023-02-13 10:10:13,484 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 26b939721b7f4b358debc749c8a565cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995667 2023-02-13 10:10:13,484 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 921b1eeddfb540158b5d07d3e5c4ea80, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997567 2023-02-13 10:10:13,484 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 706b7c271c89432eac62b9f57d0a70c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999494 2023-02-13 10:10:13,485 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting e7f46f7244154d5f9446f174003656b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 10:10:13,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5] to archive 2023-02-13 10:10:13,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:13,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/25d42fd67a824a47b13c35ffcc6b1db9 2023-02-13 10:10:13,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/e58ac7ca88d34bfe8746a2e0e8f9422e 2023-02-13 10:10:13,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5f6fd253048c46ea8939151a1493c4b9 2023-02-13 10:10:13,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/5baee855b9034746a57c384a3932be6d 2023-02-13 10:10:13,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/ab14cfd0079e4568817799d15ddf42f5 2023-02-13 10:10:13,502 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): fb0bfb57d3c4dd764ac4f766a0595ed0#family2#compaction#113 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:13,924 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del 2023-02-13 10:10:13,924 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del 2023-02-13 10:10:14,753 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 180ffbd53d064ceeb4865b2cd9bb8f56 2023-02-13 10:10:14,754 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/180ffbd53d064ceeb4865b2cd9bb8f56 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/180ffbd53d064ceeb4865b2cd9bb8f56 2023-02-13 10:10:14,758 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 180ffbd53d064ceeb4865b2cd9bb8f56 2023-02-13 10:10:14,759 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fb0bfb57d3c4dd764ac4f766a0595ed0/family2 of fb0bfb57d3c4dd764ac4f766a0595ed0 into 180ffbd53d064ceeb4865b2cd9bb8f56(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:14,759 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:14,765 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:14,770 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:14,776 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:14,777 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:14,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6] to archive 2023-02-13 10:10:14,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:14,786 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:10:14,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/7bc70cba12ff496482c2a71dfe18d637 2023-02-13 10:10:14,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/26b939721b7f4b358debc749c8a565cf 2023-02-13 10:10:14,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/921b1eeddfb540158b5d07d3e5c4ea80 2023-02-13 10:10:14,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/706b7c271c89432eac62b9f57d0a70c4 2023-02-13 10:10:14,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/e7f46f7244154d5f9446f174003656b6 2023-02-13 10:10:14,819 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 10:10:14,822 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del 2023-02-13 10:10:14,825 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del 2023-02-13 10:10:14,829 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del 2023-02-13 10:10:14,829 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:14,829 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(139): Connect 0x29c9e2d8 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:14,862 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33818f0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:14,862 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:14,862 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:14,862 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:15,741 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf 2023-02-13 10:10:15,742 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8 2023-02-13 10:10:15,742 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e 2023-02-13 10:10:15,742 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,742 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,742 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,754 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:15,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:15,763 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:10:15,765 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:10:15,776 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/6db3516e150a487ca5cac4d5ebb5fac8 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 10:10:15,776 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/1357538c65264dce9170f0be5ce5fe5f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 10:10:15,776 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/56d163c7ea4d40a7916b2218171fc872 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 10:10:15,778 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/6db3516e150a487ca5cac4d5ebb5fac8}] 2023-02-13 10:10:15,778 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/1357538c65264dce9170f0be5ce5fe5f}] 2023-02-13 10:10:15,778 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/56d163c7ea4d40a7916b2218171fc872}] 2023-02-13 10:10:15,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/56d163c7ea4d40a7916b2218171fc872 for inclusion in 045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:15,784 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/6db3516e150a487ca5cac4d5ebb5fac8 for inclusion in 28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:15,785 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/1357538c65264dce9170f0be5ce5fe5f for inclusion in fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:15,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/1357538c65264dce9170f0be5ce5fe5f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__p85fqr95jr4hmjkcg47jf5csmm9n3cn9np48bgpmpgh6drb88cmeuq3n5c3f4261/family1/1357538c65264dce9170f0be5ce5fe5f 2023-02-13 10:10:15,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/6db3516e150a487ca5cac4d5ebb5fac8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__9qbok6ogseps8tln2bv72j4j60se14hfes0elqsp704noop6jhg6urm82qfe49rh/family1/6db3516e150a487ca5cac4d5ebb5fac8 2023-02-13 10:10:15,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/56d163c7ea4d40a7916b2218171fc872 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__rj2thmlt1nhlln0h8p115srcqmkj0bgafognlbg1hm1aemel9u1ek7lbvpeeq56q/family1/56d163c7ea4d40a7916b2218171fc872 2023-02-13 10:10:15,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__p85fqr95jr4hmjkcg47jf5csmm9n3cn9np48bgpmpgh6drb88cmeuq3n5c3f4261/family1/1357538c65264dce9170f0be5ce5fe5f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ 2023-02-13 10:10:15,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__9qbok6ogseps8tln2bv72j4j60se14hfes0elqsp704noop6jhg6urm82qfe49rh/family1/6db3516e150a487ca5cac4d5ebb5fac8 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ 2023-02-13 10:10:15,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__rj2thmlt1nhlln0h8p115srcqmkj0bgafognlbg1hm1aemel9u1ek7lbvpeeq56q/family1/56d163c7ea4d40a7916b2218171fc872 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ 2023-02-13 10:10:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__p85fqr95jr4hmjkcg47jf5csmm9n3cn9np48bgpmpgh6drb88cmeuq3n5c3f4261/family1/1357538c65264dce9170f0be5ce5fe5f into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ - updating store file list. 2023-02-13 10:10:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__9qbok6ogseps8tln2bv72j4j60se14hfes0elqsp704noop6jhg6urm82qfe49rh/family1/6db3516e150a487ca5cac4d5ebb5fac8 into 28631355208dcbda9e47f3d8787b6622/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ - updating store file list. 2023-02-13 10:10:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__rj2thmlt1nhlln0h8p115srcqmkj0bgafognlbg1hm1aemel9u1ek7lbvpeeq56q/family1/56d163c7ea4d40a7916b2218171fc872 into 045f8a90e57c08d60c807c425d886d84/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ - updating store file list. 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ into 045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ into 28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__9qbok6ogseps8tln2bv72j4j60se14hfes0elqsp704noop6jhg6urm82qfe49rh/family1/6db3516e150a487ca5cac4d5ebb5fac8 into 28631355208dcbda9e47f3d8787b6622/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_) 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__rj2thmlt1nhlln0h8p115srcqmkj0bgafognlbg1hm1aemel9u1ek7lbvpeeq56q/family1/56d163c7ea4d40a7916b2218171fc872 into 045f8a90e57c08d60c807c425d886d84/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_) 2023-02-13 10:10:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__p85fqr95jr4hmjkcg47jf5csmm9n3cn9np48bgpmpgh6drb88cmeuq3n5c3f4261/family1/1357538c65264dce9170f0be5ce5fe5f into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_) 2023-02-13 10:10:15,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__9qbok6ogseps8tln2bv72j4j60se14hfes0elqsp704noop6jhg6urm82qfe49rh/family1/6db3516e150a487ca5cac4d5ebb5fac8 2023-02-13 10:10:15,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__p85fqr95jr4hmjkcg47jf5csmm9n3cn9np48bgpmpgh6drb88cmeuq3n5c3f4261/family1/1357538c65264dce9170f0be5ce5fe5f 2023-02-13 10:10:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__rj2thmlt1nhlln0h8p115srcqmkj0bgafognlbg1hm1aemel9u1ek7lbvpeeq56q/family1/56d163c7ea4d40a7916b2218171fc872 2023-02-13 10:10:15,796 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,796 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,796 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,797 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,797 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,797 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,798 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac 2023-02-13 10:10:15,798 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc 2023-02-13 10:10:15,798 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 2023-02-13 10:10:15,799 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb 2023-02-13 10:10:15,799 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c 2023-02-13 10:10:15,799 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 2023-02-13 10:10:15,800 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 2023-02-13 10:10:15,800 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 2023-02-13 10:10:15,800 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 2023-02-13 10:10:15,801 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 2023-02-13 10:10:15,801 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 10:10:15,801 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 2023-02-13 10:10:15,801 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:15,801 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:15,801 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 10:10:15,802 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:15,802 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:15,802 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:15,802 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del] 2023-02-13 10:10:15,802 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,803 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213da2c17b9ef174ebba7565d0a398936b4_del 2023-02-13 10:10:15,803 INFO [Listener at localhost.localdomain/39579] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 10:10:15,803 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del] 2023-02-13 10:10:15,804 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,805 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213ee31f29db8184f2398d8604d917d3e1b_del 2023-02-13 10:10:15,805 INFO [Listener at localhost.localdomain/39579] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 10:10:15,805 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del] 2023-02-13 10:10:15,806 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:15,806 DEBUG [Listener at localhost.localdomain/39579] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021378f8d7398f724074a244d36438505c42_del 2023-02-13 10:10:15,807 INFO [Listener at localhost.localdomain/39579] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 10:10:15,810 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:15,812 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:15,815 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:15,816 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:15,821 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-13 10:10:15,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$11(2405): Client=jenkins//188.40.62.62 disable testCompactionWithHFileLink 2023-02-13 10:10:15,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-13 10:10:15,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 10:10:15,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283015824"}]},"ts":"1676283015824"} 2023-02-13 10:10:15,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-13 10:10:15,853 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-13 10:10:15,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, UNASSIGN}] 2023-02-13 10:10:15,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, UNASSIGN 2023-02-13 10:10:15,856 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, UNASSIGN 2023-02-13 10:10:15,856 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, UNASSIGN 2023-02-13 10:10:15,857 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:15,857 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283015857"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283015857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283015857"}]},"ts":"1676283015857"} 2023-02-13 10:10:15,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:15,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:15,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283015857"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283015857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283015857"}]},"ts":"1676283015857"} 2023-02-13 10:10:15,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283015857"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283015857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283015857"}]},"ts":"1676283015857"} 2023-02-13 10:10:15,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:15,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:15,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:15,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 10:10:16,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:16,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 28631355208dcbda9e47f3d8787b6622, disabling compactions & flushes 2023-02-13 10:10:16,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:16,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:16,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. after waiting 0 ms 2023-02-13 10:10:16,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:16,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 10:10:16,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:16,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 28631355208dcbda9e47f3d8787b6622: Waiting for close lock at 1676283016013Running coprocessor pre-close hooks at 1676283016013Disabling compacts and flushes for region at 1676283016013Disabling writes for close at 1676283016013Writing region close event to WAL at 1676283016015 (+2 ms)Running coprocessor post-close hooks at 1676283016021 (+6 ms)Closed at 1676283016023 (+2 ms) 2023-02-13 10:10:16,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:16,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:16,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing fb0bfb57d3c4dd764ac4f766a0595ed0, disabling compactions & flushes 2023-02-13 10:10:16,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:16,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:16,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. after waiting 0 ms 2023-02-13 10:10:16,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:16,027 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=CLOSED 2023-02-13 10:10:16,027 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283016027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283016027"}]},"ts":"1676283016027"} 2023-02-13 10:10:16,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-02-13 10:10:16,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622 in 170 msec 2023-02-13 10:10:16,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, UNASSIGN in 177 msec 2023-02-13 10:10:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 10:10:16,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:16,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for fb0bfb57d3c4dd764ac4f766a0595ed0: Waiting for close lock at 1676283016026Running coprocessor pre-close hooks at 1676283016026Disabling compacts and flushes for region at 1676283016026Disabling writes for close at 1676283016027 (+1 ms)Writing region close event to WAL at 1676283016029 (+2 ms)Running coprocessor post-close hooks at 1676283016032 (+3 ms)Closed at 1676283016033 (+1 ms) 2023-02-13 10:10:16,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:16,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 045f8a90e57c08d60c807c425d886d84, disabling compactions & flushes 2023-02-13 10:10:16,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. after waiting 0 ms 2023-02-13 10:10:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:16,035 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=CLOSED 2023-02-13 10:10:16,035 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283016035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283016035"}]},"ts":"1676283016035"} 2023-02-13 10:10:16,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-13 10:10:16,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622 in 177 msec 2023-02-13 10:10:16,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 10:10:16,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, UNASSIGN in 184 msec 2023-02-13 10:10:16,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:16,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 045f8a90e57c08d60c807c425d886d84: Waiting for close lock at 1676283016035Running coprocessor pre-close hooks at 1676283016035Disabling compacts and flushes for region at 1676283016035Disabling writes for close at 1676283016035Writing region close event to WAL at 1676283016036 (+1 ms)Running coprocessor post-close hooks at 1676283016039 (+3 ms)Closed at 1676283016040 (+1 ms) 2023-02-13 10:10:16,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:16,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=CLOSED 2023-02-13 10:10:16,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283016042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283016042"}]},"ts":"1676283016042"} 2023-02-13 10:10:16,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-02-13 10:10:16,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622 in 182 msec 2023-02-13 10:10:16,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-13 10:10:16,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, UNASSIGN in 190 msec 2023-02-13 10:10:16,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283016045"}]},"ts":"1676283016045"} 2023-02-13 10:10:16,046 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-13 10:10:16,053 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-13 10:10:16,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 232 msec 2023-02-13 10:10:16,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 10:10:16,127 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-13 10:10:16,140 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:16,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1580): Client=jenkins//188.40.62.62 snapshot request for:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:16,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676283016142 (current time:1676283016142). 2023-02-13 10:10:16,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 10:10:16,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] zookeeper.ReadOnlyZKClient(139): Connect 0x71505812 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:16,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e872637, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:16,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:16,157 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:16,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71505812 to 127.0.0.1:57475 2023-02-13 10:10:16,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:10:16,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 10:10:16,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:16,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:16,162 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:16,163 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676283616163 2023-02-13 10:10:16,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:16,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676283001374-1676283016140 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 10:10:16,164 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:16,164 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 10:10:16,264 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:16,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:16,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:16,267 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 10:10:16,468 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:16,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:16,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:16,471 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 10:10:16,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 10:10:16,580 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/2a1d78e2542c46deb39f225b74e84ab7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_] hfiles 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/2a1d78e2542c46deb39f225b74e84ab7 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/6c3461efb4e8449cbcf51b6b038a7f98] hfiles 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf] hfiles 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/6c3461efb4e8449cbcf51b6b038a7f98 2023-02-13 10:10:16,582 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/3ff03d71149342f69640685553069331, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_] hfiles 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/3ff03d71149342f69640685553069331 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2] hfiles 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/d8353f356e42409ab10de1b4fa9283e0] hfiles 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/d8353f356e42409ab10de1b4fa9283e0 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/180ffbd53d064ceeb4865b2cd9bb8f56] hfiles 2023-02-13 10:10:16,583 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/180ffbd53d064ceeb4865b2cd9bb8f56 2023-02-13 10:10:16,586 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del] hfiles 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213882293a0558043c8ba0a7d7583c86607 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c0b39b0084cf4ba9bb9d1b028ad4cb3d 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c9c04c7644964fe1bc01f2a38a41e63d 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3de1f2fa6be4da8bd3356a45ef7a5cc 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302131c25a28939b34d1f949123242b47bdb8 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302136d05aed4ebd044a8a27e3f4388152ce0 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302139d2fb5e5061f4f919746b84ff1123a7d 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f6e0634f9208402da4103df0503435ef 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302131cfd991999394500a26795823511be62 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302132e0157100d97447cb698d99a0f845c47 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021353b9e7c5e9854cc89f7c7a77b49b2715 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213a701190b6d8f4ebc8a303b9bd06f595f 2023-02-13 10:10:16,587 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del 2023-02-13 10:10:16,771 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:16,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:16,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:16,773 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 10:10:17,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-13 10:10:17,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:17,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:17,273 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:17,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:17,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:17,276 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 10:10:17,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676283001374-1676283016140 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:18,277 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:18,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:18,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 10:10:18,280 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-13 10:10:18,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676283001374-1676283016140 of table testCompactionWithHFileLink completed 2023-02-13 10:10:18,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:18,282 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:18,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676283001374-1676283016140 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676283016164Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676283016576 (+412 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676283001374-1676283016140 at 1676283017003 (+427 ms)Loading Region manifests for hbase-failsafe-snaptb-1676283001374-1676283016140 at 1676283017003Writing data manifest for hbase-failsafe-snaptb-1676283001374-1676283016140 at 1676283017009 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1676283001374-1676283016140 at 1676283017420 (+411 ms)Snapshot hbase-failsafe-snaptb-1676283001374-1676283016140 of table testCompactionWithHFileLink completed at 1676283018280 (+860 ms) 2023-02-13 10:10:18,283 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 10:10:18,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1220 sec 2023-02-13 10:10:20,281 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 10:10:20,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 10:10:20,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676283001374-1676283016140 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 10:10:20,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676283001374" table: "testCompactionWithHFileLink" creation_time: 1676283001391 type: FLUSH version: 2 ttl: 0 ) 2023-02-13 10:10:20,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676283001374 as table=testCompactionWithHFileLink 2023-02-13 10:10:20,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 10:10:20,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 10:10:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 10:10:20,732 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 10:10:20,734 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 10:10:20,734 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 10:10:20,735 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 10:10:20,742 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676283001374" table: "testCompactionWithHFileLink" creation_time: 1676283001391 type: FLUSH version: 2 ttl: 0 2023-02-13 10:10:20,743 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink 2023-02-13 10:10:20,749 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-13 10:10:20,754 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213443ff8badf8d4d0db83b679acc3f08b8 2023-02-13 10:10:20,756 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213e414dff34760455aaac790974b0ef22e 2023-02-13 10:10:20,757 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213f6a3293f0c494e79991d40b9d18175cf 2023-02-13 10:10:20,758 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,762 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,767 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,770 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,774 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,777 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,780 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,783 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,786 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,789 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,792 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,797 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 of snapshot=snaptb-1676283001374 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 10:10:20,802 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213819ca4efbaaa42648fef73433a03644e_del 2023-02-13 10:10:20,803 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d1a8aee23e334dc99371a9b5f3730554_del 2023-02-13 10:10:20,803 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213fb779b624bd64c4ca51ede96e7808447_del 2023-02-13 10:10:20,804 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:20,804 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:20,804 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:20,806 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/56d20109aec54ee883f926f70e71961c_SeqId_29_ 2023-02-13 10:10:20,806 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/2a1d78e2542c46deb39f225b74e84ab7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/2a1d78e2542c46deb39f225b74e84ab7 2023-02-13 10:10:20,806 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/3ff03d71149342f69640685553069331 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/3ff03d71149342f69640685553069331 2023-02-13 10:10:20,807 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/6c3461efb4e8449cbcf51b6b038a7f98 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/6c3461efb4e8449cbcf51b6b038a7f98 2023-02-13 10:10:20,807 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1cedc3ebc36b45d6b35dd519fa3beb15 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,807 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/f72f034b91e9456eb8a6200353bfef94_SeqId_29_ 2023-02-13 10:10:20,807 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a7926f4c74b3454e90041b9e1e34dacf_SeqId_29_ 2023-02-13 10:10:20,807 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f25aedfaa2d5472f9e61fd002af594e6 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,808 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 25d42fd67a824a47b13c35ffcc6b1db9 of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,810 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1f8499c5e37647bdaa200fdb6ec326a5 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,810 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 005aca765bda4f6ea3b322c68fe31135 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,810 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e58ac7ca88d34bfe8746a2e0e8f9422e of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,813 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4c409857a7c24676a7a960ed242ac1c5 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,813 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0151342c142744cbafeedcca88f92fd1 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,813 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5f6fd253048c46ea8939151a1493c4b9 of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,816 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ae6ed13ecf814d0ea26e0a5bb6b06262 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,816 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 07f9ce2cd97948e7b60768422265299b of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,816 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5baee855b9034746a57c384a3932be6d of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,822 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/46b2a1cfe4e745daa9d7d1ac90dbedd2 2023-02-13 10:10:20,822 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/180ffbd53d064ceeb4865b2cd9bb8f56 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/180ffbd53d064ceeb4865b2cd9bb8f56 2023-02-13 10:10:20,822 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7bc70cba12ff496482c2a71dfe18d637 of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,822 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0c4a4a807a7f471c9aacf3413499d973 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,823 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/d8353f356e42409ab10de1b4fa9283e0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/d8353f356e42409ab10de1b4fa9283e0 2023-02-13 10:10:20,823 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a175cd0da074476fa03c05830b5947d2 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,825 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 26b939721b7f4b358debc749c8a565cf of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,825 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 19e9e626fd444449b10da0f17372ae2b of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,826 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 607cc515bf164866939fce9249dd6d3d of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,828 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 921b1eeddfb540158b5d07d3e5c4ea80 of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,828 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 85561f5897c248a8bb9d513992fef4e1 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,829 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0094f07d0a304d2f809799aaa357f9c4 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,831 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 706b7c271c89432eac62b9f57d0a70c4 of snapshot=snaptb-1676283001374 to region=fb0bfb57d3c4dd764ac4f766a0595ed0 table=testCompactionWithHFileLink 2023-02-13 10:10:20,831 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0b5e3e9688414f478bbc6791e4004619 of snapshot=snaptb-1676283001374 to region=28631355208dcbda9e47f3d8787b6622 table=testCompactionWithHFileLink 2023-02-13 10:10:20,831 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 25f1b0e38f51439988a3098f4333e836 of snapshot=snaptb-1676283001374 to region=045f8a90e57c08d60c807c425d886d84 table=testCompactionWithHFileLink 2023-02-13 10:10:20,835 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676283001374" table: "testCompactionWithHFileLink" creation_time: 1676283001391 type: FLUSH version: 2 ttl: 0 2023-02-13 10:10:20,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676283020836"}]},"ts":"9223372036854775807"} 2023-02-13 10:10:20,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676283020836"}]},"ts":"9223372036854775807"} 2023-02-13 10:10:20,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676283020836"}]},"ts":"9223372036854775807"} 2023-02-13 10:10:20,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-13 10:10:20,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 045f8a90e57c08d60c807c425d886d84, NAME => 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 28631355208dcbda9e47f3d8787b6622, NAME => 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => fb0bfb57d3c4dd764ac4f766a0595ed0, NAME => 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 10:10:20,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283020837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283020837"}]},"ts":"1676283020837"} 2023-02-13 10:10:20,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283020837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283020837"}]},"ts":"1676283020837"} 2023-02-13 10:10:20,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283020837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283020837"}]},"ts":"1676283020837"} 2023-02-13 10:10:20,839 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 10:10:20,839 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-13 10:10:20,839 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 045f8a90e57c08d60c807c425d886d84, NAME => 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 28631355208dcbda9e47f3d8787b6622, NAME => 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => fb0bfb57d3c4dd764ac4f766a0595ed0, NAME => 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 10:10:20,840 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676283001374 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-13 10:10:20,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676283001374" table: "testCompactionWithHFileLink" creation_time: 1676283001391 type: FLUSH version: 2 ttl: 0 ) in 525 msec 2023-02-13 10:10:20,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 10:10:20,929 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-13 10:10:20,929 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:20,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(748): Client=jenkins//188.40.62.62 delete name: "hbase-failsafe-snaptb-1676283001374-1676283016140" 2023-02-13 10:10:20,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676283001374-1676283016140 2023-02-13 10:10:20,941 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-13 10:10:20,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.HMaster$10(2372): Client=jenkins//188.40.62.62 enable testCompactionWithHFileLink 2023-02-13 10:10:20,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-13 10:10:20,955 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-13 10:10:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283020955"}]},"ts":"1676283020955"} 2023-02-13 10:10:20,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 10:10:20,956 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 10:10:20,996 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-13 10:10:20,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN}] 2023-02-13 10:10:20,999 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN 2023-02-13 10:10:20,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN 2023-02-13 10:10:20,999 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN 2023-02-13 10:10:21,000 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 10:10:21,000 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 10:10:21,000 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 10:10:21,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 10:10:21,151 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,151 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,151 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283021151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283021151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283021151"}]},"ts":"1676283021151"} 2023-02-13 10:10:21,151 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283021151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283021151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283021151"}]},"ts":"1676283021151"} 2023-02-13 10:10:21,151 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283021151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283021151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283021151"}]},"ts":"1676283021151"} 2023-02-13 10:10:21,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:21,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:21,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 10:10:21,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:21,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fb0bfb57d3c4dd764ac4f766a0595ed0, NAME => 'testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 10:10:21,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:21,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,314 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,315 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:21,315 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:21,316 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0bfb57d3c4dd764ac4f766a0595ed0 columnFamilyName family1 2023-02-13 10:10:21,338 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9 2023-02-13 10:10:21,343 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d 2023-02-13 10:10:21,347 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9 2023-02-13 10:10:21,352 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e 2023-02-13 10:10:21,353 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(310): Store=fb0bfb57d3c4dd764ac4f766a0595ed0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,353 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,354 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2 2023-02-13 10:10:21,354 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2 2023-02-13 10:10:21,355 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0bfb57d3c4dd764ac4f766a0595ed0 columnFamilyName family2 2023-02-13 10:10:21,365 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf 2023-02-13 10:10:21,370 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4 2023-02-13 10:10:21,376 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637 2023-02-13 10:10:21,382 DEBUG [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80 2023-02-13 10:10:21,383 INFO [StoreOpener-fb0bfb57d3c4dd764ac4f766a0595ed0-1] regionserver.HStore(310): Store=fb0bfb57d3c4dd764ac4f766a0595ed0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:21,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:10:21,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened fb0bfb57d3c4dd764ac4f766a0595ed0; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68518459, jitterRate=0.021004602313041687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:21,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for fb0bfb57d3c4dd764ac4f766a0595ed0: Running coprocessor pre-open hook at 1676283021312Writing region info on filesystem at 1676283021312Initializing all the Stores at 1676283021313 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021313Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021313Cleaning up temporary data from old regions at 1676283021385 (+72 ms)Cleaning up detritus from prior splits at 1676283021385Running coprocessor post-open hooks at 1676283021387 (+2 ms)Region opened successfully at 1676283021387 2023-02-13 10:10:21,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., pid=101, masterSystemTime=1676283021304 2023-02-13 10:10:21,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:21,388 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 10:10:21,388 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 10:10:21,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 10:10:21,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:21,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:21,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:21,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 045f8a90e57c08d60c807c425d886d84, NAME => 'testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 10:10:21,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fb0bfb57d3c4dd764ac4f766a0595ed0, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,390 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283021389"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283021389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283021389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283021389"}]},"ts":"1676283021389"} 2023-02-13 10:10:21,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:21,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,391 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 10:10:21,391 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 10:10:21,391 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1912): fb0bfb57d3c4dd764ac4f766a0595ed0/family2 is initiating minor compaction (all files) 2023-02-13 10:10:21,391 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1912): fb0bfb57d3c4dd764ac4f766a0595ed0/family1 is initiating minor compaction (all files) 2023-02-13 10:10:21,391 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of fb0bfb57d3c4dd764ac4f766a0595ed0/family1 in testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:21,391 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,391 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2258): Starting compaction of fb0bfb57d3c4dd764ac4f766a0595ed0/family2 in testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:10:21,391 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp, totalSize=21.6 K 2023-02-13 10:10:21,391 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp, totalSize=20.4 K 2023-02-13 10:10:21,392 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993724 2023-02-13 10:10:21,392 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993724 2023-02-13 10:10:21,392 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:21,392 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:21,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-02-13 10:10:21,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure fb0bfb57d3c4dd764ac4f766a0595ed0, server=jenkins-hbase16.apache.org,38311,1676282881622 in 238 msec 2023-02-13 10:10:21,393 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 045f8a90e57c08d60c807c425d886d84 columnFamilyName family1 2023-02-13 10:10:21,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fb0bfb57d3c4dd764ac4f766a0595ed0, ASSIGN in 396 msec 2023-02-13 10:10:21,394 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995667 2023-02-13 10:10:21,394 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995667 2023-02-13 10:10:21,394 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997567 2023-02-13 10:10:21,395 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997567 2023-02-13 10:10:21,395 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999494 2023-02-13 10:10:21,395 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999494 2023-02-13 10:10:21,409 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15 2023-02-13 10:10:21,417 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5 2023-02-13 10:10:21,428 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5 2023-02-13 10:10:21,431 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): fb0bfb57d3c4dd764ac4f766a0595ed0#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:21,431 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] throttle.PressureAwareThroughputController(145): fb0bfb57d3c4dd764ac4f766a0595ed0#family2#compaction#115 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:21,444 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262 2023-02-13 10:10:21,444 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(310): Store=045f8a90e57c08d60c807c425d886d84/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,444 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,445 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2 2023-02-13 10:10:21,445 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2 2023-02-13 10:10:21,445 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 045f8a90e57c08d60c807c425d886d84 columnFamilyName family2 2023-02-13 10:10:21,458 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4 2023-02-13 10:10:21,463 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836 2023-02-13 10:10:21,468 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d 2023-02-13 10:10:21,472 DEBUG [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2 2023-02-13 10:10:21,473 INFO [StoreOpener-045f8a90e57c08d60c807c425d886d84-1] regionserver.HStore(310): Store=045f8a90e57c08d60c807c425d886d84/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:21,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:10:21,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 045f8a90e57c08d60c807c425d886d84; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70646807, jitterRate=0.05271945893764496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:21,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 045f8a90e57c08d60c807c425d886d84: Running coprocessor pre-open hook at 1676283021390Writing region info on filesystem at 1676283021390Initializing all the Stores at 1676283021391 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021391Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021391Cleaning up temporary data from old regions at 1676283021475 (+84 ms)Cleaning up detritus from prior splits at 1676283021475Running coprocessor post-open hooks at 1676283021478 (+3 ms)Region opened successfully at 1676283021478 2023-02-13 10:10:21,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., pid=103, masterSystemTime=1676283021304 2023-02-13 10:10:21,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 10:10:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 10:10:21,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:21,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:21,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:21,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28631355208dcbda9e47f3d8787b6622, NAME => 'testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 10:10:21,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=045f8a90e57c08d60c807c425d886d84, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283021480"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283021480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283021480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283021480"}]},"ts":"1676283021480"} 2023-02-13 10:10:21,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:21,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,482 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,483 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:21,483 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:21,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-02-13 10:10:21,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 045f8a90e57c08d60c807c425d886d84, server=jenkins-hbase16.apache.org,38311,1676282881622 in 328 msec 2023-02-13 10:10:21,483 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28631355208dcbda9e47f3d8787b6622 columnFamilyName family1 2023-02-13 10:10:21,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=045f8a90e57c08d60c807c425d886d84, ASSIGN in 487 msec 2023-02-13 10:10:21,490 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135 2023-02-13 10:10:21,495 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1 2023-02-13 10:10:21,500 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b 2023-02-13 10:10:21,505 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6 2023-02-13 10:10:21,505 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(310): Store=28631355208dcbda9e47f3d8787b6622/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,505 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,506 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2 2023-02-13 10:10:21,506 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2 2023-02-13 10:10:21,506 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28631355208dcbda9e47f3d8787b6622 columnFamilyName family2 2023-02-13 10:10:21,513 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619 2023-02-13 10:10:21,518 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973 2023-02-13 10:10:21,523 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b 2023-02-13 10:10:21,527 DEBUG [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1 2023-02-13 10:10:21,528 INFO [StoreOpener-28631355208dcbda9e47f3d8787b6622-1] regionserver.HStore(310): Store=28631355208dcbda9e47f3d8787b6622/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:21,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:21,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:10:21,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 28631355208dcbda9e47f3d8787b6622; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75369365, jitterRate=0.12309105694293976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:21,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 28631355208dcbda9e47f3d8787b6622: Running coprocessor pre-open hook at 1676283021481Writing region info on filesystem at 1676283021481Initializing all the Stores at 1676283021481Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021481Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283021482 (+1 ms)Cleaning up temporary data from old regions at 1676283021530 (+48 ms)Cleaning up detritus from prior splits at 1676283021530Running coprocessor post-open hooks at 1676283021532 (+2 ms)Region opened successfully at 1676283021532 2023-02-13 10:10:21,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., pid=102, masterSystemTime=1676283021304 2023-02-13 10:10:21,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 10:10:21,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 10:10:21,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:21,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:21,535 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=28631355208dcbda9e47f3d8787b6622, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:21,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676283021534"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283021534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283021534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283021534"}]},"ts":"1676283021534"} 2023-02-13 10:10:21,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-13 10:10:21,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 28631355208dcbda9e47f3d8787b6622, server=jenkins-hbase16.apache.org,38311,1676282881622 in 383 msec 2023-02-13 10:10:21,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-13 10:10:21,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=28631355208dcbda9e47f3d8787b6622, ASSIGN in 541 msec 2023-02-13 10:10:21,539 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283021539"}]},"ts":"1676283021539"} 2023-02-13 10:10:21,540 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 10:10:21,556 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:10:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 10:10:21,578 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-13 10:10:21,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 631 msec 2023-02-13 10:10:21,880 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family1/a96bb0f837d549b594892bc31306af08 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/a96bb0f837d549b594892bc31306af08 2023-02-13 10:10:21,886 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 10:10:21,887 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fb0bfb57d3c4dd764ac4f766a0595ed0/family1 of fb0bfb57d3c4dd764ac4f766a0595ed0 into a96bb0f837d549b594892bc31306af08(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:21,887 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:21,887 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., storeName=fb0bfb57d3c4dd764ac4f766a0595ed0/family1, priority=12, startTime=1676283021387; duration=0sec 2023-02-13 10:10:21,887 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 10:10:21,888 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 10:10:21,891 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 10:10:21,891 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1912): 045f8a90e57c08d60c807c425d886d84/family1 is initiating minor compaction (all files) 2023-02-13 10:10:21,891 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 045f8a90e57c08d60c807c425d886d84/family1 in testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:21,891 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp, totalSize=21.6 K 2023-02-13 10:10:21,892 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993726 2023-02-13 10:10:21,893 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:21,894 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997568 2023-02-13 10:10:21,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d] to archive 2023-02-13 10:10:21,894 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:21,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:21,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-25d42fd67a824a47b13c35ffcc6b1db9 2023-02-13 10:10:21,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-e58ac7ca88d34bfe8746a2e0e8f9422e 2023-02-13 10:10:21,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5f6fd253048c46ea8939151a1493c4b9 2023-02-13 10:10:21,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-5baee855b9034746a57c384a3932be6d 2023-02-13 10:10:21,913 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 045f8a90e57c08d60c807c425d886d84#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:22,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 10:10:22,061 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-13 10:10:22,077 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:22,087 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:22,095 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:22,096 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:22,103 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:10:22,121 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 10:10:22,121 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:22,121 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(139): Connect 0x1050777b to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:22,154 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d0a111, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:22,154 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:22,154 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:22,154 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:22,274 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/.tmp/family2/3d5d57a54306432aaafaf18b3af3785d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/3d5d57a54306432aaafaf18b3af3785d 2023-02-13 10:10:22,279 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fb0bfb57d3c4dd764ac4f766a0595ed0/family2 of fb0bfb57d3c4dd764ac4f766a0595ed0 into 3d5d57a54306432aaafaf18b3af3785d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:22,279 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:22,279 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., storeName=fb0bfb57d3c4dd764ac4f766a0595ed0/family2, priority=12, startTime=1676283021388; duration=0sec 2023-02-13 10:10:22,279 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 10:10:22,280 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 10:10:22,282 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 10:10:22,282 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1912): 28631355208dcbda9e47f3d8787b6622/family2 is initiating minor compaction (all files) 2023-02-13 10:10:22,282 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 28631355208dcbda9e47f3d8787b6622/family2 in testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:22,282 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp, totalSize=20.4 K 2023-02-13 10:10:22,282 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993728 2023-02-13 10:10:22,283 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:22,283 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997569 2023-02-13 10:10:22,284 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:22,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4] to archive 2023-02-13 10:10:22,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:22,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-7bc70cba12ff496482c2a71dfe18d637 2023-02-13 10:10:22,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-26b939721b7f4b358debc749c8a565cf 2023-02-13 10:10:22,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-921b1eeddfb540158b5d07d3e5c4ea80 2023-02-13 10:10:22,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family2/testCompactionWithHFileLink=fb0bfb57d3c4dd764ac4f766a0595ed0-706b7c271c89432eac62b9f57d0a70c4 2023-02-13 10:10:22,295 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] throttle.PressureAwareThroughputController(145): 28631355208dcbda9e47f3d8787b6622#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:23,015 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131e11959c794e40bbaf9043fa6b28baf9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302131e11959c794e40bbaf9043fa6b28baf9 2023-02-13 10:10:23,015 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021338c115f79646428ebe089edb32767eec to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021338c115f79646428ebe089edb32767eec 2023-02-13 10:10:23,015 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213be1fe22e9302402aaebd91d136895ca9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213be1fe22e9302402aaebd91d136895ca9 2023-02-13 10:10:23,017 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,017 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,017 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,029 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:23,033 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:44542, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:23,038 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:10:23,042 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:56070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:10:23,063 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/14424e95d6534988bc657c06f9bccdf3 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-13 10:10:23,063 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/740506ccc5704a7a892d3494ec93227c first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-13 10:10:23,064 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/ffbfbe31e9e34a73b40c29c95bb94610 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-13 10:10:23,065 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/740506ccc5704a7a892d3494ec93227c}] 2023-02-13 10:10:23,065 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/14424e95d6534988bc657c06f9bccdf3}] 2023-02-13 10:10:23,065 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/ffbfbe31e9e34a73b40c29c95bb94610}] 2023-02-13 10:10:23,075 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/ffbfbe31e9e34a73b40c29c95bb94610 for inclusion in 28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:23,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/740506ccc5704a7a892d3494ec93227c for inclusion in fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:23,075 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/14424e95d6534988bc657c06f9bccdf3 for inclusion in 045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for fb0bfb57d3c4dd764ac4f766a0595ed0: 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:23,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:23,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/14424e95d6534988bc657c06f9bccdf3 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__50v4o65tipj3gil4igch1dvlp0e0otblj63tpbk5hccin0vml3s9771q9pijvl43/family1/14424e95d6534988bc657c06f9bccdf3 2023-02-13 10:10:23,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/ffbfbe31e9e34a73b40c29c95bb94610 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__uvku2a1r3fu6mb5dvmbr8qmqnf2h1a5ifppo0v189pheqthlnttfg0h9455g1iv3/family1/ffbfbe31e9e34a73b40c29c95bb94610 2023-02-13 10:10:23,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/740506ccc5704a7a892d3494ec93227c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__1nhgrn8pq8is37ha18ei29il6k9htv7d8mh5f0qhh628ani7dgbutjo88adkq7d7/family1/740506ccc5704a7a892d3494ec93227c 2023-02-13 10:10:23,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__50v4o65tipj3gil4igch1dvlp0e0otblj63tpbk5hccin0vml3s9771q9pijvl43/family1/14424e95d6534988bc657c06f9bccdf3 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/30268d716141430e9d5e574e74ba3b47_SeqId_34_ 2023-02-13 10:10:23,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__uvku2a1r3fu6mb5dvmbr8qmqnf2h1a5ifppo0v189pheqthlnttfg0h9455g1iv3/family1/ffbfbe31e9e34a73b40c29c95bb94610 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_ 2023-02-13 10:10:23,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__1nhgrn8pq8is37ha18ei29il6k9htv7d8mh5f0qhh628ani7dgbutjo88adkq7d7/family1/740506ccc5704a7a892d3494ec93227c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/817e826903bb4d99a481fe8d0db3889d_SeqId_36_ 2023-02-13 10:10:23,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__50v4o65tipj3gil4igch1dvlp0e0otblj63tpbk5hccin0vml3s9771q9pijvl43/family1/14424e95d6534988bc657c06f9bccdf3 into 045f8a90e57c08d60c807c425d886d84/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/30268d716141430e9d5e574e74ba3b47_SeqId_34_ - updating store file list. 2023-02-13 10:10:23,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__1nhgrn8pq8is37ha18ei29il6k9htv7d8mh5f0qhh628ani7dgbutjo88adkq7d7/family1/740506ccc5704a7a892d3494ec93227c into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/817e826903bb4d99a481fe8d0db3889d_SeqId_36_ - updating store file list. 2023-02-13 10:10:23,080 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__uvku2a1r3fu6mb5dvmbr8qmqnf2h1a5ifppo0v189pheqthlnttfg0h9455g1iv3/family1/ffbfbe31e9e34a73b40c29c95bb94610 into 28631355208dcbda9e47f3d8787b6622/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_ - updating store file list. 2023-02-13 10:10:23,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/30268d716141430e9d5e574e74ba3b47_SeqId_34_ into 045f8a90e57c08d60c807c425d886d84/family1 2023-02-13 10:10:23,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__50v4o65tipj3gil4igch1dvlp0e0otblj63tpbk5hccin0vml3s9771q9pijvl43/family1/14424e95d6534988bc657c06f9bccdf3 into 045f8a90e57c08d60c807c425d886d84/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/30268d716141430e9d5e574e74ba3b47_SeqId_34_) 2023-02-13 10:10:23,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__50v4o65tipj3gil4igch1dvlp0e0otblj63tpbk5hccin0vml3s9771q9pijvl43/family1/14424e95d6534988bc657c06f9bccdf3 2023-02-13 10:10:23,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/817e826903bb4d99a481fe8d0db3889d_SeqId_36_ into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 2023-02-13 10:10:23,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__1nhgrn8pq8is37ha18ei29il6k9htv7d8mh5f0qhh628ani7dgbutjo88adkq7d7/family1/740506ccc5704a7a892d3494ec93227c into fb0bfb57d3c4dd764ac4f766a0595ed0/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/family1/817e826903bb4d99a481fe8d0db3889d_SeqId_36_) 2023-02-13 10:10:23,084 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_ into 28631355208dcbda9e47f3d8787b6622/family1 2023-02-13 10:10:23,084 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__uvku2a1r3fu6mb5dvmbr8qmqnf2h1a5ifppo0v189pheqthlnttfg0h9455g1iv3/family1/ffbfbe31e9e34a73b40c29c95bb94610 into 28631355208dcbda9e47f3d8787b6622/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_) 2023-02-13 10:10:23,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__1nhgrn8pq8is37ha18ei29il6k9htv7d8mh5f0qhh628ani7dgbutjo88adkq7d7/family1/740506ccc5704a7a892d3494ec93227c 2023-02-13 10:10:23,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testCompactionWithHFileLink__uvku2a1r3fu6mb5dvmbr8qmqnf2h1a5ifppo0v189pheqthlnttfg0h9455g1iv3/family1/ffbfbe31e9e34a73b40c29c95bb94610 2023-02-13 10:10:23,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:23,085 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,086 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,086 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:23,086 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:23,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 10:10:23,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(1912): 28631355208dcbda9e47f3d8787b6622/family1 is initiating minor compaction (all files) 2023-02-13 10:10:23,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@730aacd8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 10:10:23,087 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021323fc1e52a04a49758b4ae333fc3177ac 2023-02-13 10:10:23,088 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302135bb9d29442384d7aac60defbe4ac2e38 2023-02-13 10:10:23,088 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b13e893d38b04aa49de58715188704fb 2023-02-13 10:10:23,089 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213711359bc46674865a8a9acf8ab83db9c 2023-02-13 10:10:23,089 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b3aeef109c244e88953e4218a1e46060 2023-02-13 10:10:23,090 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a7d98b5becab4d129cc555094598fdf7 2023-02-13 10:10:23,090 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213f8bec120a902459dac8979c3b0853c35 2023-02-13 10:10:23,090 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:23,090 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 10:10:23,091 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,091 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:23,091 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a9c4b4df85e74524b0ab13749b1a2d97 2023-02-13 10:10:23,091 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:23,091 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 10:10:23,091 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:23,091 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:23,092 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021329ebafe35def4c1e91dc3712fe2893fc 2023-02-13 10:10:23,093 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137447b7c4f3cf4610b4539772865066d5 2023-02-13 10:10:23,094 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213782acfb5eb2b419fbee35676f3a87367 2023-02-13 10:10:23,094 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213f0ebe44d010e406eb7ee0ea22594d2e8 2023-02-13 10:10:23,094 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 10:10:23,094 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 10:10:23,095 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 10:10:23,095 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 10:10:23,099 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:23,101 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:23,104 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:23,105 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:23,112 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:23,113 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:23,126 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=273 (was 252) - Thread LEAK? -, OpenFileDescriptor=731 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=95 (was 157), ProcessCount=165 (was 165), AvailableMemoryMB=7674 (was 7813) 2023-02-13 10:10:23,135 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family1/37d936aba7744bb6a865cd432219629b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/37d936aba7744bb6a865cd432219629b 2023-02-13 10:10:23,137 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=273, OpenFileDescriptor=731, MaxFileDescriptor=60000, SystemLoadAverage=95, ProcessCount=165, AvailableMemoryMB=7674 2023-02-13 10:10:23,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 045f8a90e57c08d60c807c425d886d84/family1 of 045f8a90e57c08d60c807c425d886d84 into 37d936aba7744bb6a865cd432219629b(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:23,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:23,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., storeName=045f8a90e57c08d60c807c425d886d84/family1, priority=12, startTime=1676283021478; duration=1sec 2023-02-13 10:10:23,140 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 10:10:23,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 28631355208dcbda9e47f3d8787b6622/family1 in testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:10:23,140 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp, totalSize=28.9 K 2023-02-13 10:10:23,141 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993728 2023-02-13 10:10:23,142 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:23,142 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997569 2023-02-13 10:10:23,143 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:23,143 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 87e473f74a394839b039756573bef670_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676282993728 2023-02-13 10:10:23,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.HMaster$15(2997): Client=jenkins//188.40.62.62 creating {NAME => 'ns'} 2023-02-13 10:10:23,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-13 10:10:23,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 10:10:23,157 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 28631355208dcbda9e47f3d8787b6622#family1#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:23,161 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 10:10:23,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 26 msec 2023-02-13 10:10:23,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262] to archive 2023-02-13 10:10:23,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:23,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1cedc3ebc36b45d6b35dd519fa3beb15 2023-02-13 10:10:23,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-1f8499c5e37647bdaa200fdb6ec326a5 2023-02-13 10:10:23,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-4c409857a7c24676a7a960ed242ac1c5 2023-02-13 10:10:23,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family1/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-ae6ed13ecf814d0ea26e0a5bb6b06262 2023-02-13 10:10:23,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 10:10:23,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 10:10:23,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-13 10:10:23,257 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:10:23,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-13 10:10:23,259 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:10:23,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 10:10:23,262 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:23,263 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:23,263 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:23,263 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4 empty. 2023-02-13 10:10:23,263 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b empty. 2023-02-13 10:10:23,263 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f empty. 2023-02-13 10:10:23,264 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:23,264 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:23,264 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:23,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-13 10:10:23,274 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 10:10:23,276 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 46e20509df636f8c5fceac1b22b8703f, NAME => 'ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:23,276 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => f23999f2ff6bec9ffff86cfc8321429b, NAME => 'ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:23,276 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 99dbf187396b633bba7f84c449d532d4, NAME => 'ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:23,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 10:10:23,524 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family2/c89e83da18c6429ea5df97b91b0d53d9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/c89e83da18c6429ea5df97b91b0d53d9 2023-02-13 10:10:23,530 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 28631355208dcbda9e47f3d8787b6622/family2 of 28631355208dcbda9e47f3d8787b6622 into c89e83da18c6429ea5df97b91b0d53d9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:23,530 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:23,530 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., storeName=28631355208dcbda9e47f3d8787b6622/family2, priority=12, startTime=1676283021533; duration=1sec 2023-02-13 10:10:23,530 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 10:10:23,530 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-13 10:10:23,530 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 10:10:23,530 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 10:10:23,531 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. because compaction request was cancelled 2023-02-13 10:10:23,531 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 10:10:23,534 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 10:10:23,534 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1912): 045f8a90e57c08d60c807c425d886d84/family2 is initiating minor compaction (all files) 2023-02-13 10:10:23,534 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 045f8a90e57c08d60c807c425d886d84/family2 in testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:10:23,534 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp, totalSize=20.4 K 2023-02-13 10:10:23,535 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676282993726 2023-02-13 10:10:23,536 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676282995668 2023-02-13 10:10:23,537 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676282997568 2023-02-13 10:10:23,538 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676282999495 2023-02-13 10:10:23,555 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] throttle.PressureAwareThroughputController(145): 045f8a90e57c08d60c807c425d886d84#family2#compaction#119 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:23,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 10:10:23,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619] to archive 2023-02-13 10:10:23,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:23,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0c4a4a807a7f471c9aacf3413499d973 2023-02-13 10:10:23,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-19e9e626fd444449b10da0f17372ae2b 2023-02-13 10:10:23,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-85561f5897c248a8bb9d513992fef4e1 2023-02-13 10:10:23,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family2/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0b5e3e9688414f478bbc6791e4004619 2023-02-13 10:10:23,685 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:23,685 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing f23999f2ff6bec9ffff86cfc8321429b, disabling compactions & flushes 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 46e20509df636f8c5fceac1b22b8703f, disabling compactions & flushes 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 99dbf187396b633bba7f84c449d532d4, disabling compactions & flushes 2023-02-13 10:10:23,686 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:23,686 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. after waiting 0 ms 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:23,686 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:23,686 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:23,687 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. after waiting 0 ms 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for f23999f2ff6bec9ffff86cfc8321429b: Waiting for close lock at 1676283023685Disabling compacts and flushes for region at 1676283023686 (+1 ms)Disabling writes for close at 1676283023687 (+1 ms)Writing region close event to WAL at 1676283023687Closed at 1676283023687 2023-02-13 10:10:23,687 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:23,687 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. after waiting 0 ms 2023-02-13 10:10:23,688 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 99dbf187396b633bba7f84c449d532d4: Waiting for close lock at 1676283023686Disabling compacts and flushes for region at 1676283023686Disabling writes for close at 1676283023687 (+1 ms)Writing region close event to WAL at 1676283023687Closed at 1676283023687 2023-02-13 10:10:23,688 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:23,688 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:23,688 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 46e20509df636f8c5fceac1b22b8703f: Waiting for close lock at 1676283023686Disabling compacts and flushes for region at 1676283023686Disabling writes for close at 1676283023688 (+2 ms)Writing region close event to WAL at 1676283023688Closed at 1676283023688 2023-02-13 10:10:23,692 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:10:23,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676283023694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283023694"}]},"ts":"1676283023694"} 2023-02-13 10:10:23,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283023694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283023694"}]},"ts":"1676283023694"} 2023-02-13 10:10:23,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283023694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283023694"}]},"ts":"1676283023694"} 2023-02-13 10:10:23,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 10:10:23,697 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:10:23,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283023697"}]},"ts":"1676283023697"} 2023-02-13 10:10:23,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-13 10:10:23,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99dbf187396b633bba7f84c449d532d4, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f23999f2ff6bec9ffff86cfc8321429b, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e20509df636f8c5fceac1b22b8703f, ASSIGN}] 2023-02-13 10:10:23,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e20509df636f8c5fceac1b22b8703f, ASSIGN 2023-02-13 10:10:23,738 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f23999f2ff6bec9ffff86cfc8321429b, ASSIGN 2023-02-13 10:10:23,738 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99dbf187396b633bba7f84c449d532d4, ASSIGN 2023-02-13 10:10:23,739 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e20509df636f8c5fceac1b22b8703f, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:23,739 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f23999f2ff6bec9ffff86cfc8321429b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:23,739 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99dbf187396b633bba7f84c449d532d4, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:23,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 10:10:23,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=46e20509df636f8c5fceac1b22b8703f, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:23,892 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f23999f2ff6bec9ffff86cfc8321429b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:23,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=99dbf187396b633bba7f84c449d532d4, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:23,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676283023892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283023892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283023892"}]},"ts":"1676283023892"} 2023-02-13 10:10:23,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283023892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283023892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283023892"}]},"ts":"1676283023892"} 2023-02-13 10:10:23,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283023892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283023892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283023892"}]},"ts":"1676283023892"} 2023-02-13 10:10:23,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure f23999f2ff6bec9ffff86cfc8321429b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:23,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 99dbf187396b633bba7f84c449d532d4, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:23,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 46e20509df636f8c5fceac1b22b8703f, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:24,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:24,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 46e20509df636f8c5fceac1b22b8703f, NAME => 'ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 10:10:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,055 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,057 DEBUG [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1 2023-02-13 10:10:24,058 DEBUG [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1 2023-02-13 10:10:24,058 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46e20509df636f8c5fceac1b22b8703f columnFamilyName family1 2023-02-13 10:10:24,060 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] regionserver.HStore(310): Store=46e20509df636f8c5fceac1b22b8703f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,060 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,062 DEBUG [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2 2023-02-13 10:10:24,062 DEBUG [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2 2023-02-13 10:10:24,062 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46e20509df636f8c5fceac1b22b8703f columnFamilyName family2 2023-02-13 10:10:24,064 INFO [StoreOpener-46e20509df636f8c5fceac1b22b8703f-1] regionserver.HStore(310): Store=46e20509df636f8c5fceac1b22b8703f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:24,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:10:24,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:24,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 46e20509df636f8c5fceac1b22b8703f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66901608, jitterRate=-0.00308835506439209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:24,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 46e20509df636f8c5fceac1b22b8703f: Running coprocessor pre-open hook at 1676283024053Writing region info on filesystem at 1676283024053Initializing all the Stores at 1676283024055 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024055Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024055Cleaning up temporary data from old regions at 1676283024066 (+11 ms)Cleaning up detritus from prior splits at 1676283024067 (+1 ms)Running coprocessor post-open hooks at 1676283024072 (+5 ms)Region opened successfully at 1676283024072 2023-02-13 10:10:24,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f., pid=111, masterSystemTime=1676283024047 2023-02-13 10:10:24,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:24,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:24,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:24,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 99dbf187396b633bba7f84c449d532d4, NAME => 'ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 10:10:24,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=46e20509df636f8c5fceac1b22b8703f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:24,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283024074"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283024074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283024074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283024074"}]},"ts":"1676283024074"} 2023-02-13 10:10:24,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:24,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,077 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-02-13 10:10:24,078 DEBUG [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1 2023-02-13 10:10:24,078 DEBUG [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1 2023-02-13 10:10:24,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 46e20509df636f8c5fceac1b22b8703f, server=jenkins-hbase16.apache.org,38311,1676282881622 in 179 msec 2023-02-13 10:10:24,079 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dbf187396b633bba7f84c449d532d4 columnFamilyName family1 2023-02-13 10:10:24,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e20509df636f8c5fceac1b22b8703f, ASSIGN in 342 msec 2023-02-13 10:10:24,080 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] regionserver.HStore(310): Store=99dbf187396b633bba7f84c449d532d4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,080 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,081 DEBUG [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2 2023-02-13 10:10:24,081 DEBUG [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2 2023-02-13 10:10:24,082 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dbf187396b633bba7f84c449d532d4 columnFamilyName family2 2023-02-13 10:10:24,082 INFO [StoreOpener-99dbf187396b633bba7f84c449d532d4-1] regionserver.HStore(310): Store=99dbf187396b633bba7f84c449d532d4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:24,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:10:24,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:24,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 99dbf187396b633bba7f84c449d532d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59380361, jitterRate=-0.11516366899013519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:24,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 99dbf187396b633bba7f84c449d532d4: Running coprocessor pre-open hook at 1676283024075Writing region info on filesystem at 1676283024075Initializing all the Stores at 1676283024076 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024076Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024076Cleaning up temporary data from old regions at 1676283024084 (+8 ms)Cleaning up detritus from prior splits at 1676283024084Running coprocessor post-open hooks at 1676283024086 (+2 ms)Region opened successfully at 1676283024086 2023-02-13 10:10:24,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4., pid=110, masterSystemTime=1676283024047 2023-02-13 10:10:24,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:24,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:24,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:24,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f23999f2ff6bec9ffff86cfc8321429b, NAME => 'ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 10:10:24,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=99dbf187396b633bba7f84c449d532d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:24,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,088 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676283024088"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283024088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283024088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283024088"}]},"ts":"1676283024088"} 2023-02-13 10:10:24,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:24,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,089 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,090 DEBUG [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1 2023-02-13 10:10:24,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-13 10:10:24,090 DEBUG [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1 2023-02-13 10:10:24,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 99dbf187396b633bba7f84c449d532d4, server=jenkins-hbase16.apache.org,38311,1676282881622 in 193 msec 2023-02-13 10:10:24,090 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f23999f2ff6bec9ffff86cfc8321429b columnFamilyName family1 2023-02-13 10:10:24,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99dbf187396b633bba7f84c449d532d4, ASSIGN in 354 msec 2023-02-13 10:10:24,091 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] regionserver.HStore(310): Store=f23999f2ff6bec9ffff86cfc8321429b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,091 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,092 DEBUG [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2 2023-02-13 10:10:24,092 DEBUG [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2 2023-02-13 10:10:24,093 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f23999f2ff6bec9ffff86cfc8321429b columnFamilyName family2 2023-02-13 10:10:24,093 INFO [StoreOpener-f23999f2ff6bec9ffff86cfc8321429b-1] regionserver.HStore(310): Store=f23999f2ff6bec9ffff86cfc8321429b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:24,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:24,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:10:24,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:24,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened f23999f2ff6bec9ffff86cfc8321429b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59629186, jitterRate=-0.11145588755607605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:24,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for f23999f2ff6bec9ffff86cfc8321429b: Running coprocessor pre-open hook at 1676283024088Writing region info on filesystem at 1676283024088Initializing all the Stores at 1676283024089 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024089Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283024089Cleaning up temporary data from old regions at 1676283024095 (+6 ms)Cleaning up detritus from prior splits at 1676283024095Running coprocessor post-open hooks at 1676283024098 (+3 ms)Region opened successfully at 1676283024098 2023-02-13 10:10:24,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b., pid=109, masterSystemTime=1676283024047 2023-02-13 10:10:24,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:24,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:24,099 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f23999f2ff6bec9ffff86cfc8321429b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:24,099 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676283024099"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283024099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283024099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283024099"}]},"ts":"1676283024099"} 2023-02-13 10:10:24,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-02-13 10:10:24,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure f23999f2ff6bec9ffff86cfc8321429b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 205 msec 2023-02-13 10:10:24,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-02-13 10:10:24,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f23999f2ff6bec9ffff86cfc8321429b, ASSIGN in 365 msec 2023-02-13 10:10:24,102 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:10:24,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283024102"}]},"ts":"1676283024102"} 2023-02-13 10:10:24,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-13 10:10:24,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:10:24,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 883 msec 2023-02-13 10:10:24,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 10:10:24,367 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-13 10:10:24,378 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:24,379 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:24,379 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:24,380 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/.tmp/family1/bd9fbbd84790446d8a2d29857a15c4c6 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/bd9fbbd84790446d8a2d29857a15c4c6 2023-02-13 10:10:24,381 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:24,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 10:10:24,383 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 10:10:24,383 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:24,383 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 10:10:24,383 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 10:10:24,383 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:24,383 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:24,384 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 28631355208dcbda9e47f3d8787b6622/family1 of 28631355208dcbda9e47f3d8787b6622 into bd9fbbd84790446d8a2d29857a15c4c6(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:24,384 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 28631355208dcbda9e47f3d8787b6622: 2023-02-13 10:10:24,385 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676283023087; duration=1sec 2023-02-13 10:10:24,385 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:24,393 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:24,393 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:24,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:24,394 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:24,394 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:24,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:24,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 10:10:24,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 10:10:24,395 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 10:10:24,395 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:24,395 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 10:10:24,395 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:24,395 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. started... 2023-02-13 10:10:24,395 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:24,395 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:24,397 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 46e20509df636f8c5fceac1b22b8703f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:24,395 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:24,397 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. started... 2023-02-13 10:10:24,395 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:24,397 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. started... 2023-02-13 10:10:24,397 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99dbf187396b633bba7f84c449d532d4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:24,397 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f23999f2ff6bec9ffff86cfc8321429b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:24,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_] to archive 2023-02-13 10:10:24,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:24,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-f25aedfaa2d5472f9e61fd002af594e6 2023-02-13 10:10:24,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-005aca765bda4f6ea3b322c68fe31135 2023-02-13 10:10:24,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-0151342c142744cbafeedcca88f92fd1 2023-02-13 10:10:24,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/testCompactionWithHFileLink=28631355208dcbda9e47f3d8787b6622-07f9ce2cd97948e7b60768422265299b 2023-02-13 10:10:24,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/family1/87e473f74a394839b039756573bef670_SeqId_34_ 2023-02-13 10:10:24,790 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/.tmp/family2/665fac5a57524bfbbeb55802a168e649 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/665fac5a57524bfbbeb55802a168e649 2023-02-13 10:10:24,796 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 045f8a90e57c08d60c807c425d886d84/family2 of 045f8a90e57c08d60c807c425d886d84 into 665fac5a57524bfbbeb55802a168e649(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:24,796 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 045f8a90e57c08d60c807c425d886d84: 2023-02-13 10:10:24,796 INFO [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84., storeName=045f8a90e57c08d60c807c425d886d84/family2, priority=12, startTime=1676283021478; duration=1sec 2023-02-13 10:10:24,796 DEBUG [RS:0;jenkins-hbase16:38311-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:24,815 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134df743130c04438ead465a1d6a2a4225 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302134df743130c04438ead465a1d6a2a4225 2023-02-13 10:10:24,815 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213324d897e9a2d426187304bf0f82e152c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213324d897e9a2d426187304bf0f82e152c 2023-02-13 10:10:24,815 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021369bb597552cc44b9a92a1d4e551d7f73 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021369bb597552cc44b9a92a1d4e551d7f73 2023-02-13 10:10:24,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836] to archive 2023-02-13 10:10:24,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:24,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-a175cd0da074476fa03c05830b5947d2 2023-02-13 10:10:24,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-607cc515bf164866939fce9249dd6d3d 2023-02-13 10:10:24,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-0094f07d0a304d2f809799aaa357f9c4 2023-02-13 10:10:24,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/family2/testCompactionWithHFileLink=045f8a90e57c08d60c807c425d886d84-25f1b0e38f51439988a3098f4333e836 2023-02-13 10:10:25,223 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/a5eee14420b143109a4f3328a5672559 2023-02-13 10:10:25,223 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/49207fda454244948a2ec42cfc48f563 2023-02-13 10:10:25,223 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/08ae730140384ff39252d5a15d080165 2023-02-13 10:10:25,656 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fed1126ee62f4601a2381255ea84aec5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213fed1126ee62f4601a2381255ea84aec5 2023-02-13 10:10:25,656 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213f7634a7611f44ee7b88d5dfb91dbed57 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213f7634a7611f44ee7b88d5dfb91dbed57 2023-02-13 10:10:25,656 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213350ede6fcbcc4c9f9ca6e1ae765d987a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213350ede6fcbcc4c9f9ca6e1ae765d987a 2023-02-13 10:10:26,062 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/b2a440b1286b4fe7b8b5ae032f88c98c 2023-02-13 10:10:26,063 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/a36b6e6cfb5d4874916b689cf08cad1e 2023-02-13 10:10:26,063 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/2e549df05332438e93f9e0d17f41cff5 2023-02-13 10:10:26,071 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/a5eee14420b143109a4f3328a5672559 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559 2023-02-13 10:10:26,071 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/08ae730140384ff39252d5a15d080165 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165 2023-02-13 10:10:26,071 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/49207fda454244948a2ec42cfc48f563 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563 2023-02-13 10:10:26,075 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:10:26,075 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:10:26,076 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 10:10:26,076 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/a36b6e6cfb5d4874916b689cf08cad1e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e 2023-02-13 10:10:26,076 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/b2a440b1286b4fe7b8b5ae032f88c98c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c 2023-02-13 10:10:26,076 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/2e549df05332438e93f9e0d17f41cff5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5 2023-02-13 10:10:26,080 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:26,080 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:26,080 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:26,081 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 46e20509df636f8c5fceac1b22b8703f in 1684ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:26,081 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f23999f2ff6bec9ffff86cfc8321429b in 1684ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:26,081 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 99dbf187396b633bba7f84c449d532d4 in 1684ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:26,081 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 10:10:26,081 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 10:10:26,081 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:26,082 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 10:10:26,082 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 10:10:26,111 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,111 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:26,111 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:26,111 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 10:10:26,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28fbd818[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:26,112 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 10:10:26,112 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,119 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,119 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 10:10:26,119 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 10:10:26,119 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:26,119 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,119 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:26,127 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 10:10:26,127 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,127 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:26,128 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 10:10:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:26,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 10:10:26,130 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 10:10:26,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:26,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:26,130 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 10:10:26,130 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:26,136 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,136 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:26,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,136 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:26,136 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,137 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:26,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:26,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,144 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:26,144 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,144 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:26,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 10:10:26,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:26,144 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:26,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:26,144 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 10:10:26,145 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:26,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:26,245 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:26,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:26,248 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:26,248 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:26,248 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:26,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:26,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:26,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 10:10:26,254 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 10:10:26,254 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:26,254 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 10:10:26,254 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 10:10:26,255 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,255 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:26,261 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:26,261 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:26,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:26,262 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:26,262 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:26,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:26,263 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 10:10:26,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 10:10:26,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 10:10:26,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 10:10:26,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:26,264 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. started... 2023-02-13 10:10:26,265 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:26,265 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. started... 2023-02-13 10:10:26,265 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 46e20509df636f8c5fceac1b22b8703f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:26,265 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f23999f2ff6bec9ffff86cfc8321429b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:10:26,265 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. started... 2023-02-13 10:10:26,266 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99dbf187396b633bba7f84c449d532d4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:10:26,691 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021396ab1ab7800c4b71b2e16c616c632d24 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021396ab1ab7800c4b71b2e16c616c632d24 2023-02-13 10:10:26,691 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302132a7083cc6f7f4fe4adad482f02ca4661 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302132a7083cc6f7f4fe4adad482f02ca4661 2023-02-13 10:10:26,691 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213915dc3d5af894440acec3259de3beac9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213915dc3d5af894440acec3259de3beac9 2023-02-13 10:10:26,814 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:10:27,098 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/0ee01ebc0597499289f5c3c4b18e2273 2023-02-13 10:10:27,102 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/cb3032e4b24f47db95efd34fca03e53f 2023-02-13 10:10:27,103 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/23e5cb65cb914e74bd36e52c50218ee7 2023-02-13 10:10:27,134 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134b3cec3b552f41a6854cbf56c9b243a2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302134b3cec3b552f41a6854cbf56c9b243a2 2023-02-13 10:10:27,537 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bcf266ecff8b42f8961e9449b9c30857 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213bcf266ecff8b42f8961e9449b9c30857 2023-02-13 10:10:27,540 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/cd94c5ef85fe4ab6b8e489e907f42543 2023-02-13 10:10:27,541 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302134ce3c20e95494675988ea1ca23bf0395 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302134ce3c20e95494675988ea1ca23bf0395 2023-02-13 10:10:27,549 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/0ee01ebc0597499289f5c3c4b18e2273 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273 2023-02-13 10:10:27,552 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:10:27,553 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/cd94c5ef85fe4ab6b8e489e907f42543 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543 2023-02-13 10:10:27,557 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:10:27,557 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 46e20509df636f8c5fceac1b22b8703f in 1292ms, sequenceid=9, compaction requested=false 2023-02-13 10:10:27,558 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:27,558 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:27,558 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:27,951 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/4fdd2400cf9d46c686132e6a69fc265e 2023-02-13 10:10:27,957 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/23e5cb65cb914e74bd36e52c50218ee7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7 2023-02-13 10:10:27,957 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/f5a2724f62f34f5698e6936e730d7cfd 2023-02-13 10:10:27,962 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:10:27,962 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/cb3032e4b24f47db95efd34fca03e53f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f 2023-02-13 10:10:27,963 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/4fdd2400cf9d46c686132e6a69fc265e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e 2023-02-13 10:10:27,967 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:10:27,967 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 10:10:27,968 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 99dbf187396b633bba7f84c449d532d4 in 1702ms, sequenceid=9, compaction requested=false 2023-02-13 10:10:27,968 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/f5a2724f62f34f5698e6936e730d7cfd as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd 2023-02-13 10:10:27,968 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:27,968 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:27,968 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:27,973 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:10:27,974 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f23999f2ff6bec9ffff86cfc8321429b in 1709ms, sequenceid=9, compaction requested=false 2023-02-13 10:10:27,974 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:27,974 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:27,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:27,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:27,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:27,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 10:10:27,974 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 10:10:28,027 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,027 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:28,028 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,028 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:28,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 10:10:28,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@189ab597[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:28,030 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 10:10:28,030 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,044 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 10:10:28,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 10:10:28,044 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:28,045 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,045 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:28,053 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 10:10:28,053 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:28,053 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,053 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 10:10:28,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:28,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:28,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:28,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 10:10:28,059 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 10:10:28,059 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:28,059 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:28,059 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 10:10:28,060 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:28,069 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,069 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:28,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,070 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:28,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:28,071 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,074 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,086 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,086 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:28,086 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:28,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:28,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 10:10:28,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:28,086 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:28,086 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:28,086 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:28,087 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:28,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:28,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:28,188 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:28,192 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:28,193 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:28,194 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:28,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:28,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:28,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 10:10:28,201 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 10:10:28,201 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:28,201 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 10:10:28,201 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 10:10:28,202 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,202 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:28,211 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,211 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:28,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:28,211 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:28,211 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:28,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:28,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 10:10:28,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 10:10:28,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 10:10:28,212 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 10:10:28,212 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:28,212 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 10:10:28,212 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:28,212 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. started... 2023-02-13 10:10:28,212 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:28,212 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:28,213 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 46e20509df636f8c5fceac1b22b8703f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:10:28,213 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:28,213 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. started... 2023-02-13 10:10:28,213 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. started... 2023-02-13 10:10:28,213 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99dbf187396b633bba7f84c449d532d4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:10:28,213 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:28,213 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f23999f2ff6bec9ffff86cfc8321429b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:10:28,632 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134981740f7dc0480eba08c5a78b7af7f9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302134981740f7dc0480eba08c5a78b7af7f9 2023-02-13 10:10:28,633 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213455fa6f8f59d4a51a81ef354cf8bf9e0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213455fa6f8f59d4a51a81ef354cf8bf9e0 2023-02-13 10:10:28,633 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302139066b5622b03447bb978725d9a482ecf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302139066b5622b03447bb978725d9a482ecf 2023-02-13 10:10:29,039 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7 2023-02-13 10:10:29,039 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/c882be52b0964119b4ba57c56f2dfb88 2023-02-13 10:10:29,039 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/24029e7e21a247be91503e9976fa099c 2023-02-13 10:10:29,465 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021306a71fa0aa134f6a93f65e67308523c8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021306a71fa0aa134f6a93f65e67308523c8 2023-02-13 10:10:29,465 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213794967ddd6214c06b7aadf76d5bf5a15 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213794967ddd6214c06b7aadf76d5bf5a15 2023-02-13 10:10:29,465 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021356840c0c02d14605b9ac5a3868406339 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021356840c0c02d14605b9ac5a3868406339 2023-02-13 10:10:29,872 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/10f202a2786d47e2acac0879b6a44d96 2023-02-13 10:10:29,872 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/8fe9b3e09ef642698310f98acdd4b3f7 2023-02-13 10:10:29,872 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/35eb6801e5d249418886118b660fc96a 2023-02-13 10:10:29,882 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/c882be52b0964119b4ba57c56f2dfb88 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88 2023-02-13 10:10:29,882 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7 2023-02-13 10:10:29,882 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/24029e7e21a247be91503e9976fa099c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c 2023-02-13 10:10:29,887 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:10:29,887 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:10:29,887 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 10:10:29,887 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/8fe9b3e09ef642698310f98acdd4b3f7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7 2023-02-13 10:10:29,887 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/10f202a2786d47e2acac0879b6a44d96 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96 2023-02-13 10:10:29,887 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/35eb6801e5d249418886118b660fc96a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a 2023-02-13 10:10:29,891 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:10:29,891 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:10:29,891 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:10:29,892 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f23999f2ff6bec9ffff86cfc8321429b in 1679ms, sequenceid=13, compaction requested=true 2023-02-13 10:10:29,892 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 46e20509df636f8c5fceac1b22b8703f in 1679ms, sequenceid=13, compaction requested=true 2023-02-13 10:10:29,892 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 99dbf187396b633bba7f84c449d532d4 in 1679ms, sequenceid=13, compaction requested=true 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:29,892 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:29,892 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 10:10:29,893 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 10:10:29,919 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,919 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:29,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:29,920 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,920 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:29,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 10:10:29,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34bc860[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:29,924 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 10:10:29,924 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,928 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,928 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 10:10:29,928 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 10:10:29,928 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,928 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:29,928 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:29,936 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 10:10:29,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:29,936 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 10:10:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:29,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:29,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 10:10:29,945 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 10:10:29,945 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:29,946 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:29,946 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 10:10:29,946 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:29,953 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,953 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,953 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:29,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:29,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:29,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:29,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:29,955 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,958 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,969 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,969 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:29,969 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:29,969 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:29,969 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:29,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:29,969 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 10:10:29,970 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:29,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 10:10:29,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:29,970 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:29,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:29,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:30,071 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:30,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:30,076 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:30,077 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:30,077 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:30,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:30,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:30,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 10:10:30,085 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 10:10:30,085 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:30,085 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 10:10:30,085 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 10:10:30,085 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:30,085 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:30,094 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:30,094 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:30,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:30,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:30,094 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:30,094 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 10:10:30,095 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 10:10:30,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 10:10:30,096 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 10:10:30,096 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:30,096 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:30,096 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. started... 2023-02-13 10:10:30,096 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. started... 2023-02-13 10:10:30,096 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. started... 2023-02-13 10:10:30,096 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f23999f2ff6bec9ffff86cfc8321429b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:10:30,096 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99dbf187396b633bba7f84c449d532d4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:10:30,097 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 46e20509df636f8c5fceac1b22b8703f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:10:30,525 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213dae3a19cbb604eb78de2396c87f6104d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213dae3a19cbb604eb78de2396c87f6104d 2023-02-13 10:10:30,525 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021317db0446d1934d398ce089e443fff9bf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021317db0446d1934d398ce089e443fff9bf 2023-02-13 10:10:30,525 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136906eaab1541476f9f81779e7639d938 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302136906eaab1541476f9f81779e7639d938 2023-02-13 10:10:30,933 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/0b63ae5b4e414bc9b2bcfeb49878c35c 2023-02-13 10:10:30,933 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/afee05e69fe14e43996194b0ab22cc19 2023-02-13 10:10:30,933 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/0c07795fba5c4ec5af68680f4a6b4f6c 2023-02-13 10:10:31,358 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021389d9e53d3a8c4128a5227139eadee107 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021389d9e53d3a8c4128a5227139eadee107 2023-02-13 10:10:31,358 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e96c9f036055499babfe874f72cfdc4f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213e96c9f036055499babfe874f72cfdc4f 2023-02-13 10:10:31,359 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134c732256fa5a4340bef0190b980df4c4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302134c732256fa5a4340bef0190b980df4c4 2023-02-13 10:10:31,364 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/7bfdfc2d39fb4c53819f142edafa999f 2023-02-13 10:10:31,368 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/0b63ae5b4e414bc9b2bcfeb49878c35c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c 2023-02-13 10:10:31,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:31,372 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/7bfdfc2d39fb4c53819f142edafa999f as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f 2023-02-13 10:10:31,375 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:31,376 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 46e20509df636f8c5fceac1b22b8703f in 1279ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:31,376 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:31,377 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:31,377 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:31,764 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/ee334cba41a044a0a773e885b3ee010c 2023-02-13 10:10:31,767 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/5df44cbe1b924568854490e395a26c09 2023-02-13 10:10:31,772 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/0c07795fba5c4ec5af68680f4a6b4f6c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c 2023-02-13 10:10:31,775 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/afee05e69fe14e43996194b0ab22cc19 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19 2023-02-13 10:10:31,778 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:31,779 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 10:10:31,779 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/ee334cba41a044a0a773e885b3ee010c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c 2023-02-13 10:10:31,780 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/5df44cbe1b924568854490e395a26c09 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09 2023-02-13 10:10:31,783 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:31,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:10:31,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f23999f2ff6bec9ffff86cfc8321429b in 1688ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:31,784 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:31,784 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:31,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 99dbf187396b633bba7f84c449d532d4 in 1688ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:31,784 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:31,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:31,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:31,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:31,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:31,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 10:10:31,785 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 10:10:31,827 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,827 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:31,828 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,829 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:31,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 10:10:31,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798163fb[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:31,833 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 10:10:31,833 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:31,843 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 10:10:31,844 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 10:10:31,844 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:31,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,844 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:31,902 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 10:10:31,902 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:31,902 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,902 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 10:10:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:31,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:31,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:31,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 10:10:31,914 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 10:10:31,914 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:31,914 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:31,914 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 10:10:31,915 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:31,986 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,986 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,986 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:31,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:31,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:31,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:31,988 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:31,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:31,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,992 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:32,002 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:32,002 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:32,002 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:32,002 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:32,002 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 10:10:32,003 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:32,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:32,002 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:32,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 10:10:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:32,003 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:32,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:32,103 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:32,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:32,126 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:32,136 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:32,147 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:32,148 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:32,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:32,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:32,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 10:10:32,179 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 10:10:32,179 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:32,179 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 10:10:32,179 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 10:10:32,180 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:32,180 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:32,186 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:32,186 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:32,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:32,186 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:32,186 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:32,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:32,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 10:10:32,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 10:10:32,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 10:10:32,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 10:10:32,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:32,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 10:10:32,188 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:32,188 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. started... 2023-02-13 10:10:32,188 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:32,189 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:32,189 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. started... 2023-02-13 10:10:32,188 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:32,189 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. started... 2023-02-13 10:10:32,189 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99dbf187396b633bba7f84c449d532d4 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:32,189 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 46e20509df636f8c5fceac1b22b8703f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:32,189 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:32,189 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f23999f2ff6bec9ffff86cfc8321429b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:10:32,608 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/215e1dd92dde42819a94a6ad4c3e49d8 2023-02-13 10:10:32,610 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/4735fc4f7bd24d279a8a844e3f3af2f5 2023-02-13 10:10:32,614 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 215e1dd92dde42819a94a6ad4c3e49d8 2023-02-13 10:10:32,618 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4735fc4f7bd24d279a8a844e3f3af2f5 2023-02-13 10:10:33,018 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/25df90df9cf54e75b3ad080394bc6aef 2023-02-13 10:10:33,023 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25df90df9cf54e75b3ad080394bc6aef 2023-02-13 10:10:33,428 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/1018d26bdc4e4b99a4ca1b030dd21b6c 2023-02-13 10:10:33,439 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1018d26bdc4e4b99a4ca1b030dd21b6c 2023-02-13 10:10:33,441 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/215e1dd92dde42819a94a6ad4c3e49d8 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8 2023-02-13 10:10:33,446 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 215e1dd92dde42819a94a6ad4c3e49d8 2023-02-13 10:10:33,447 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,447 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/1018d26bdc4e4b99a4ca1b030dd21b6c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c 2023-02-13 10:10:33,451 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1018d26bdc4e4b99a4ca1b030dd21b6c 2023-02-13 10:10:33,451 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,451 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/5a5fd1e801424201b92d662f59fac526 2023-02-13 10:10:33,452 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f23999f2ff6bec9ffff86cfc8321429b in 1263ms, sequenceid=23, compaction requested=true 2023-02-13 10:10:33,452 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:33,452 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:33,452 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:33,453 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/875a16bf11084c2fbda0ca2136b5dffe 2023-02-13 10:10:33,455 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5fd1e801424201b92d662f59fac526 2023-02-13 10:10:33,456 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 875a16bf11084c2fbda0ca2136b5dffe 2023-02-13 10:10:33,456 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/25df90df9cf54e75b3ad080394bc6aef as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef 2023-02-13 10:10:33,456 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/4735fc4f7bd24d279a8a844e3f3af2f5 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5 2023-02-13 10:10:33,459 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4735fc4f7bd24d279a8a844e3f3af2f5 2023-02-13 10:10:33,459 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25df90df9cf54e75b3ad080394bc6aef 2023-02-13 10:10:33,459 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,459 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,460 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/875a16bf11084c2fbda0ca2136b5dffe as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe 2023-02-13 10:10:33,460 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/5a5fd1e801424201b92d662f59fac526 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526 2023-02-13 10:10:33,463 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5fd1e801424201b92d662f59fac526 2023-02-13 10:10:33,463 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 875a16bf11084c2fbda0ca2136b5dffe 2023-02-13 10:10:33,463 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,463 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:10:33,464 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 46e20509df636f8c5fceac1b22b8703f in 1275ms, sequenceid=23, compaction requested=true 2023-02-13 10:10:33,464 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 99dbf187396b633bba7f84c449d532d4 in 1275ms, sequenceid=23, compaction requested=true 2023-02-13 10:10:33,464 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:33,464 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:33,464 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:33,464 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 10:10:33,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 10:10:33,494 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,494 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:33,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:33,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:33,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:33,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:33,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:33,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 10:10:33,496 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 10:10:33,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f4c4fcb[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:33,496 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,525 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,525 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 10:10:33,525 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 10:10:33,525 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,525 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:33,525 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:33,535 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 10:10:33,535 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,535 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,536 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:33,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 10:10:33,538 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 10:10:33,538 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:33,538 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:33,538 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 10:10:33,538 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:33,544 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,544 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:33,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,544 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:33,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:33,545 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,546 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 10:10:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,552 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,552 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:33,552 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:33,552 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:33,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 10:10:33,552 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:33,552 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 10:10:33,553 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:33,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 10:10:33,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:33,553 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 10:10:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:33,653 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:33,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:33,656 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:33,656 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 46e20509df636f8c5fceac1b22b8703f/family1 is initiating major compaction (all files) 2023-02-13 10:10:33,656 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:33,657 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:33,657 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 46e20509df636f8c5fceac1b22b8703f/family1 in ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:33,657 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp, totalSize=26.6 K 2023-02-13 10:10:33,659 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting a5eee14420b143109a4f3328a5672559, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024379 2023-02-13 10:10:33,660 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0ee01ebc0597499289f5c3c4b18e2273, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:33,661 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting c882be52b0964119b4ba57c56f2dfb88, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028194 2023-02-13 10:10:33,662 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0b63ae5b4e414bc9b2bcfeb49878c35c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030077 2023-02-13 10:10:33,664 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 25df90df9cf54e75b3ad080394bc6aef, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:33,675 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 46e20509df636f8c5fceac1b22b8703f#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:34,088 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a21deaba566f4036ba8c42f1da74c2b0_del 2023-02-13 10:10:34,088 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a21deaba566f4036ba8c42f1da74c2b0_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213a21deaba566f4036ba8c42f1da74c2b0_del 2023-02-13 10:10:34,920 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33eb5ae27a364abdb7b62fd42f1390fb 2023-02-13 10:10:34,922 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family1/33eb5ae27a364abdb7b62fd42f1390fb as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/33eb5ae27a364abdb7b62fd42f1390fb 2023-02-13 10:10:34,929 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33eb5ae27a364abdb7b62fd42f1390fb 2023-02-13 10:10:34,930 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46e20509df636f8c5fceac1b22b8703f/family1 of 46e20509df636f8c5fceac1b22b8703f into 33eb5ae27a364abdb7b62fd42f1390fb(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:34,930 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:34,930 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:34,930 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 46e20509df636f8c5fceac1b22b8703f/family2 is initiating major compaction (all files) 2023-02-13 10:10:34,930 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:34,930 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:34,931 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 46e20509df636f8c5fceac1b22b8703f/family2 in ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:10:34,931 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp, totalSize=25.3 K 2023-02-13 10:10:34,931 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting a36b6e6cfb5d4874916b689cf08cad1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024379 2023-02-13 10:10:34,932 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting cd94c5ef85fe4ab6b8e489e907f42543, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:34,932 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 35eb6801e5d249418886118b660fc96a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028194 2023-02-13 10:10:34,933 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 7bfdfc2d39fb4c53819f142edafa999f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030077 2023-02-13 10:10:34,933 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 5a5fd1e801424201b92d662f59fac526, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:34,942 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 46e20509df636f8c5fceac1b22b8703f#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:34,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef] to archive 2023-02-13 10:10:34,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:34,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/a5eee14420b143109a4f3328a5672559 2023-02-13 10:10:34,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ee01ebc0597499289f5c3c4b18e2273 2023-02-13 10:10:34,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/c882be52b0964119b4ba57c56f2dfb88 2023-02-13 10:10:34,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0b63ae5b4e414bc9b2bcfeb49878c35c 2023-02-13 10:10:35,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/25df90df9cf54e75b3ad080394bc6aef 2023-02-13 10:10:35,359 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302137c957d1359f249a0b2592ab4fc51f6c6_del 2023-02-13 10:10:35,360 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137c957d1359f249a0b2592ab4fc51f6c6_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302137c957d1359f249a0b2592ab4fc51f6c6_del 2023-02-13 10:10:36,190 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa8ca371381f4f44b7d60e6b545f9b05 2023-02-13 10:10:36,191 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/.tmp/family2/aa8ca371381f4f44b7d60e6b545f9b05 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/aa8ca371381f4f44b7d60e6b545f9b05 2023-02-13 10:10:36,197 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa8ca371381f4f44b7d60e6b545f9b05 2023-02-13 10:10:36,198 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46e20509df636f8c5fceac1b22b8703f/family2 of 46e20509df636f8c5fceac1b22b8703f into aa8ca371381f4f44b7d60e6b545f9b05(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:36,199 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:36,199 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:36,199 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): f23999f2ff6bec9ffff86cfc8321429b/family1 is initiating major compaction (all files) 2023-02-13 10:10:36,199 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:36,199 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:36,199 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of f23999f2ff6bec9ffff86cfc8321429b/family1 in ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:36,199 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp, totalSize=26.6 K 2023-02-13 10:10:36,200 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 49207fda454244948a2ec42cfc48f563, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024379 2023-02-13 10:10:36,200 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting cb3032e4b24f47db95efd34fca03e53f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:36,201 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 24029e7e21a247be91503e9976fa099c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028193 2023-02-13 10:10:36,201 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0c07795fba5c4ec5af68680f4a6b4f6c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030077 2023-02-13 10:10:36,202 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 215e1dd92dde42819a94a6ad4c3e49d8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:36,212 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): f23999f2ff6bec9ffff86cfc8321429b#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:36,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526] to archive 2023-02-13 10:10:36,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:36,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/a36b6e6cfb5d4874916b689cf08cad1e 2023-02-13 10:10:36,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/cd94c5ef85fe4ab6b8e489e907f42543 2023-02-13 10:10:36,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/35eb6801e5d249418886118b660fc96a 2023-02-13 10:10:36,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/7bfdfc2d39fb4c53819f142edafa999f 2023-02-13 10:10:36,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family2/5a5fd1e801424201b92d662f59fac526 2023-02-13 10:10:36,633 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021310d15e6a039b40839db2d94b132fcfa6_del 2023-02-13 10:10:36,633 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021310d15e6a039b40839db2d94b132fcfa6_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021310d15e6a039b40839db2d94b132fcfa6_del 2023-02-13 10:10:37,050 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ea9d65e4a1e437c93df3b6ec8ae09c1 2023-02-13 10:10:37,051 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family1/3ea9d65e4a1e437c93df3b6ec8ae09c1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/3ea9d65e4a1e437c93df3b6ec8ae09c1 2023-02-13 10:10:37,055 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ea9d65e4a1e437c93df3b6ec8ae09c1 2023-02-13 10:10:37,056 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f23999f2ff6bec9ffff86cfc8321429b/family1 of f23999f2ff6bec9ffff86cfc8321429b into 3ea9d65e4a1e437c93df3b6ec8ae09c1(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:37,056 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:37,056 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:37,056 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): f23999f2ff6bec9ffff86cfc8321429b/family2 is initiating major compaction (all files) 2023-02-13 10:10:37,056 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:37,056 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:37,057 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of f23999f2ff6bec9ffff86cfc8321429b/family2 in ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:10:37,057 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp, totalSize=25.3 K 2023-02-13 10:10:37,057 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 2e549df05332438e93f9e0d17f41cff5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024379 2023-02-13 10:10:37,057 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting f5a2724f62f34f5698e6936e730d7cfd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:37,058 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 10f202a2786d47e2acac0879b6a44d96, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028193 2023-02-13 10:10:37,058 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting ee334cba41a044a0a773e885b3ee010c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030077 2023-02-13 10:10:37,058 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 1018d26bdc4e4b99a4ca1b030dd21b6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:37,065 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): f23999f2ff6bec9ffff86cfc8321429b#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:37,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8] to archive 2023-02-13 10:10:37,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:37,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/49207fda454244948a2ec42cfc48f563 2023-02-13 10:10:37,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/cb3032e4b24f47db95efd34fca03e53f 2023-02-13 10:10:37,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/24029e7e21a247be91503e9976fa099c 2023-02-13 10:10:37,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/0c07795fba5c4ec5af68680f4a6b4f6c 2023-02-13 10:10:37,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/215e1dd92dde42819a94a6ad4c3e49d8 2023-02-13 10:10:37,478 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021362b9af4fffe2463ca11337dfcec44d15_del 2023-02-13 10:10:37,478 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021362b9af4fffe2463ca11337dfcec44d15_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021362b9af4fffe2463ca11337dfcec44d15_del 2023-02-13 10:10:38,316 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38a10e45e4ec46e89ff61b19a11b2d94 2023-02-13 10:10:38,318 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/.tmp/family2/38a10e45e4ec46e89ff61b19a11b2d94 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/38a10e45e4ec46e89ff61b19a11b2d94 2023-02-13 10:10:38,324 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38a10e45e4ec46e89ff61b19a11b2d94 2023-02-13 10:10:38,325 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f23999f2ff6bec9ffff86cfc8321429b/family2 of f23999f2ff6bec9ffff86cfc8321429b into 38a10e45e4ec46e89ff61b19a11b2d94(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:38,325 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:38,325 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:38,325 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 99dbf187396b633bba7f84c449d532d4/family1 is initiating major compaction (all files) 2023-02-13 10:10:38,325 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:38,325 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:38,326 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 99dbf187396b633bba7f84c449d532d4/family1 in ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:38,326 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp, totalSize=26.6 K 2023-02-13 10:10:38,326 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 08ae730140384ff39252d5a15d080165, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024378 2023-02-13 10:10:38,327 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 23e5cb65cb914e74bd36e52c50218ee7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:38,327 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0d09b1c63c2c4c96b3a57f44b99d7ce7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028192 2023-02-13 10:10:38,327 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting afee05e69fe14e43996194b0ab22cc19, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030076 2023-02-13 10:10:38,328 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 4735fc4f7bd24d279a8a844e3f3af2f5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:38,338 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 99dbf187396b633bba7f84c449d532d4#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:38,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c] to archive 2023-02-13 10:10:38,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:38,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/2e549df05332438e93f9e0d17f41cff5 2023-02-13 10:10:38,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/f5a2724f62f34f5698e6936e730d7cfd 2023-02-13 10:10:38,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/10f202a2786d47e2acac0879b6a44d96 2023-02-13 10:10:38,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/ee334cba41a044a0a773e885b3ee010c 2023-02-13 10:10:38,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family2/1018d26bdc4e4b99a4ca1b030dd21b6c 2023-02-13 10:10:38,755 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302136e4bfe14052940b89f63646a6b1c051e_del 2023-02-13 10:10:38,755 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136e4bfe14052940b89f63646a6b1c051e_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302136e4bfe14052940b89f63646a6b1c051e_del 2023-02-13 10:10:39,189 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:10:39,190 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1050777b to 127.0.0.1:57475 2023-02-13 10:10:39,190 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:10:39,190 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:10:39,190 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29c9e2d8 to 127.0.0.1:57475 2023-02-13 10:10:39,190 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:10:39,190 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d33ccd56e1db4320bc2a9c49387f65e3 2023-02-13 10:10:39,191 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family1/d33ccd56e1db4320bc2a9c49387f65e3 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/d33ccd56e1db4320bc2a9c49387f65e3 2023-02-13 10:10:39,194 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d33ccd56e1db4320bc2a9c49387f65e3 2023-02-13 10:10:39,195 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99dbf187396b633bba7f84c449d532d4/family1 of 99dbf187396b633bba7f84c449d532d4 into d33ccd56e1db4320bc2a9c49387f65e3(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:39,196 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:39,196 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:10:39,196 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 99dbf187396b633bba7f84c449d532d4/family2 is initiating major compaction (all files) 2023-02-13 10:10:39,196 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:10:39,196 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:10:39,197 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 99dbf187396b633bba7f84c449d532d4/family2 in ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:10:39,197 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp, totalSize=25.3 K 2023-02-13 10:10:39,197 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b2a440b1286b4fe7b8b5ae032f88c98c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283024378 2023-02-13 10:10:39,198 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 4fdd2400cf9d46c686132e6a69fc265e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283026248 2023-02-13 10:10:39,198 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 8fe9b3e09ef642698310f98acdd4b3f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283028192 2023-02-13 10:10:39,198 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 5df44cbe1b924568854490e395a26c09, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283030076 2023-02-13 10:10:39,199 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 875a16bf11084c2fbda0ca2136b5dffe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:10:39,206 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 99dbf187396b633bba7f84c449d532d4#family2#compaction#155 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:10:39,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5] to archive 2023-02-13 10:10:39,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:39,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/08ae730140384ff39252d5a15d080165 2023-02-13 10:10:39,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/23e5cb65cb914e74bd36e52c50218ee7 2023-02-13 10:10:39,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/0d09b1c63c2c4c96b3a57f44b99d7ce7 2023-02-13 10:10:39,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/afee05e69fe14e43996194b0ab22cc19 2023-02-13 10:10:39,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/4735fc4f7bd24d279a8a844e3f3af2f5 2023-02-13 10:10:39,622 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302130d81bb58fdbf449e85b7fa2691ac551e_del 2023-02-13 10:10:39,623 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130d81bb58fdbf449e85b7fa2691ac551e_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302130d81bb58fdbf449e85b7fa2691ac551e_del 2023-02-13 10:10:40,454 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 828bc3df96364c0bb900d5dc3a8bcf79 2023-02-13 10:10:40,455 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/.tmp/family2/828bc3df96364c0bb900d5dc3a8bcf79 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/828bc3df96364c0bb900d5dc3a8bcf79 2023-02-13 10:10:40,460 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 828bc3df96364c0bb900d5dc3a8bcf79 2023-02-13 10:10:40,461 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99dbf187396b633bba7f84c449d532d4/family2 of 99dbf187396b633bba7f84c449d532d4 into 828bc3df96364c0bb900d5dc3a8bcf79(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:10:40,461 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:40,465 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:40,469 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:40,474 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:40,475 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:40,481 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:10:40,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe] to archive 2023-02-13 10:10:40,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:40,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/b2a440b1286b4fe7b8b5ae032f88c98c 2023-02-13 10:10:40,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/4fdd2400cf9d46c686132e6a69fc265e 2023-02-13 10:10:40,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/8fe9b3e09ef642698310f98acdd4b3f7 2023-02-13 10:10:40,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/5df44cbe1b924568854490e395a26c09 2023-02-13 10:10:40,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family2/875a16bf11084c2fbda0ca2136b5dffe 2023-02-13 10:10:40,499 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-13 10:10:40,502 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302136e4bfe14052940b89f63646a6b1c051e_del 2023-02-13 10:10:40,506 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021310d15e6a039b40839db2d94b132fcfa6_del 2023-02-13 10:10:40,510 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a21deaba566f4036ba8c42f1da74c2b0_del 2023-02-13 10:10:40,510 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:40,510 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(139): Connect 0x2c8e3c57 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:40,545 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d5ae43b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:40,547 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:40,547 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:40,547 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:40,979 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302131d1acba5f426415bb5c85b50a990b38c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302131d1acba5f426415bb5c85b50a990b38c 2023-02-13 10:10:40,980 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:40,989 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:40,991 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:40,997 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:10:40,999 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:10:41,015 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/76a58a4a0ff646f5baa16ee8156e6262 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-13 10:10:41,015 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/76a58a4a0ff646f5baa16ee8156e6262}] 2023-02-13 10:10:41,019 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/76a58a4a0ff646f5baa16ee8156e6262 for inclusion in f23999f2ff6bec9ffff86cfc8321429b/family1 2023-02-13 10:10:41,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-13 10:10:41,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 10:10:41,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for f23999f2ff6bec9ffff86cfc8321429b: 2023-02-13 10:10:41,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/76a58a4a0ff646f5baa16ee8156e6262 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__cbj7u6kf7itnqpviheuqds7f0u5k9p0g4ld14cjjgf2886vv4hndd5tpcjvq2j3h/family1/76a58a4a0ff646f5baa16ee8156e6262 2023-02-13 10:10:41,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__cbj7u6kf7itnqpviheuqds7f0u5k9p0g4ld14cjjgf2886vv4hndd5tpcjvq2j3h/family1/76a58a4a0ff646f5baa16ee8156e6262 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/e92cc53a18c34726bdc7fa3806c4b189_SeqId_28_ 2023-02-13 10:10:41,024 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__cbj7u6kf7itnqpviheuqds7f0u5k9p0g4ld14cjjgf2886vv4hndd5tpcjvq2j3h/family1/76a58a4a0ff646f5baa16ee8156e6262 into f23999f2ff6bec9ffff86cfc8321429b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/e92cc53a18c34726bdc7fa3806c4b189_SeqId_28_ - updating store file list. 2023-02-13 10:10:41,027 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/e92cc53a18c34726bdc7fa3806c4b189_SeqId_28_ into f23999f2ff6bec9ffff86cfc8321429b/family1 2023-02-13 10:10:41,027 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__cbj7u6kf7itnqpviheuqds7f0u5k9p0g4ld14cjjgf2886vv4hndd5tpcjvq2j3h/family1/76a58a4a0ff646f5baa16ee8156e6262 into f23999f2ff6bec9ffff86cfc8321429b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/family1/e92cc53a18c34726bdc7fa3806c4b189_SeqId_28_) 2023-02-13 10:10:41,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__cbj7u6kf7itnqpviheuqds7f0u5k9p0g4ld14cjjgf2886vv4hndd5tpcjvq2j3h/family1/76a58a4a0ff646f5baa16ee8156e6262 2023-02-13 10:10:41,030 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,030 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:41,031 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021369bb597552cc44b9a92a1d4e551d7f73 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021369bb597552cc44b9a92a1d4e551d7f73 2023-02-13 10:10:41,031 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 10:10:41,031 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 10:10:41,032 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:41,383 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213afade95fd42c42aaa2d212c6da0832b9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213afade95fd42c42aaa2d212c6da0832b9 2023-02-13 10:10:41,383 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213afd3cf795bab4cfbae335db12894fb70 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213afd3cf795bab4cfbae335db12894fb70 2023-02-13 10:10:41,385 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,385 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,410 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/0dc1c365d6a54b4e90fa4ea48c4dbade first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-13 10:10:41,410 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8a47f4563ab6468c9a90db62dbf7410a first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-13 10:10:41,411 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8a47f4563ab6468c9a90db62dbf7410a}] 2023-02-13 10:10:41,411 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/0dc1c365d6a54b4e90fa4ea48c4dbade}] 2023-02-13 10:10:41,413 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/0dc1c365d6a54b4e90fa4ea48c4dbade for inclusion in 99dbf187396b633bba7f84c449d532d4/family1 2023-02-13 10:10:41,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8a47f4563ab6468c9a90db62dbf7410a for inclusion in 46e20509df636f8c5fceac1b22b8703f/family1 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 99dbf187396b633bba7f84c449d532d4: 2023-02-13 10:10:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 46e20509df636f8c5fceac1b22b8703f: 2023-02-13 10:10:41,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/0dc1c365d6a54b4e90fa4ea48c4dbade to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__hn61erqlhh2fe1v65b2lpn7e7il8q404poniunn1san9riigdgs2saa7g026ovpi/family1/0dc1c365d6a54b4e90fa4ea48c4dbade 2023-02-13 10:10:41,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8a47f4563ab6468c9a90db62dbf7410a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__fu7vumvnu2asujv6gqfngnvh6ruid1r9qg189tcte35t9o3cnfo4v2fs55or3n3p/family1/8a47f4563ab6468c9a90db62dbf7410a 2023-02-13 10:10:41,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__hn61erqlhh2fe1v65b2lpn7e7il8q404poniunn1san9riigdgs2saa7g026ovpi/family1/0dc1c365d6a54b4e90fa4ea48c4dbade as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/f21e88d69e9b4367928ef2d4b1f0de96_SeqId_28_ 2023-02-13 10:10:41,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__fu7vumvnu2asujv6gqfngnvh6ruid1r9qg189tcte35t9o3cnfo4v2fs55or3n3p/family1/8a47f4563ab6468c9a90db62dbf7410a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ecc775cd0834fbc8f713bdb8befd691_SeqId_28_ 2023-02-13 10:10:41,418 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__hn61erqlhh2fe1v65b2lpn7e7il8q404poniunn1san9riigdgs2saa7g026ovpi/family1/0dc1c365d6a54b4e90fa4ea48c4dbade into 99dbf187396b633bba7f84c449d532d4/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/f21e88d69e9b4367928ef2d4b1f0de96_SeqId_28_ - updating store file list. 2023-02-13 10:10:41,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__fu7vumvnu2asujv6gqfngnvh6ruid1r9qg189tcte35t9o3cnfo4v2fs55or3n3p/family1/8a47f4563ab6468c9a90db62dbf7410a into 46e20509df636f8c5fceac1b22b8703f/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ecc775cd0834fbc8f713bdb8befd691_SeqId_28_ - updating store file list. 2023-02-13 10:10:41,421 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/f21e88d69e9b4367928ef2d4b1f0de96_SeqId_28_ into 99dbf187396b633bba7f84c449d532d4/family1 2023-02-13 10:10:41,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ecc775cd0834fbc8f713bdb8befd691_SeqId_28_ into 46e20509df636f8c5fceac1b22b8703f/family1 2023-02-13 10:10:41,421 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__hn61erqlhh2fe1v65b2lpn7e7il8q404poniunn1san9riigdgs2saa7g026ovpi/family1/0dc1c365d6a54b4e90fa4ea48c4dbade into 99dbf187396b633bba7f84c449d532d4/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/family1/f21e88d69e9b4367928ef2d4b1f0de96_SeqId_28_) 2023-02-13 10:10:41,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__fu7vumvnu2asujv6gqfngnvh6ruid1r9qg189tcte35t9o3cnfo4v2fs55or3n3p/family1/8a47f4563ab6468c9a90db62dbf7410a into 46e20509df636f8c5fceac1b22b8703f/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/family1/0ecc775cd0834fbc8f713bdb8befd691_SeqId_28_) 2023-02-13 10:10:41,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__hn61erqlhh2fe1v65b2lpn7e7il8q404poniunn1san9riigdgs2saa7g026ovpi/family1/0dc1c365d6a54b4e90fa4ea48c4dbade 2023-02-13 10:10:41,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__ns_testMinorCompaction__fu7vumvnu2asujv6gqfngnvh6ruid1r9qg189tcte35t9o3cnfo4v2fs55or3n3p/family1/8a47f4563ab6468c9a90db62dbf7410a 2023-02-13 10:10:41,423 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,423 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,424 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:41,424 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:41,425 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302134df743130c04438ead465a1d6a2a4225 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302134df743130c04438ead465a1d6a2a4225 2023-02-13 10:10:41,425 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213324d897e9a2d426187304bf0f82e152c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213324d897e9a2d426187304bf0f82e152c 2023-02-13 10:10:41,425 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 10:10:41,425 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 10:10:41,425 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 10:10:41,425 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 10:10:41,425 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:41,426 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 10:10:41,426 INFO [Listener at localhost.localdomain/39579] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-13 10:10:41,428 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:41,430 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:41,432 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:10:41,433 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:10:41,449 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=245 (was 273), OpenFileDescriptor=622 (was 731), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=88 (was 95), ProcessCount=165 (was 165), AvailableMemoryMB=7665 (was 7674) 2023-02-13 10:10:41,460 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=245, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=88, ProcessCount=165, AvailableMemoryMB=7664 2023-02-13 10:10:41,462 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 10:10:41,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:41,464 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:10:41,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-13 10:10:41,465 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:10:41,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:41,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:41,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f empty. 2023-02-13 10:10:41,467 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:41,467 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-13 10:10:41,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:41,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:41,876 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 10:10:41,878 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 74ee92c3cf25e92ef9b18a057ecd963f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:42,289 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:42,289 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 74ee92c3cf25e92ef9b18a057ecd963f, disabling compactions & flushes 2023-02-13 10:10:42,290 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,290 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,290 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. after waiting 0 ms 2023-02-13 10:10:42,290 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,290 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,290 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 74ee92c3cf25e92ef9b18a057ecd963f: Waiting for close lock at 1676283042289Disabling compacts and flushes for region at 1676283042289Disabling writes for close at 1676283042290 (+1 ms)Writing region close event to WAL at 1676283042290Closed at 1676283042290 2023-02-13 10:10:42,296 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:10:42,299 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676283042299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283042299"}]},"ts":"1676283042299"} 2023-02-13 10:10:42,302 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 10:10:42,304 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:10:42,304 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283042304"}]},"ts":"1676283042304"} 2023-02-13 10:10:42,304 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 10:10:42,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=74ee92c3cf25e92ef9b18a057ecd963f, ASSIGN}] 2023-02-13 10:10:42,329 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=74ee92c3cf25e92ef9b18a057ecd963f, ASSIGN 2023-02-13 10:10:42,329 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=74ee92c3cf25e92ef9b18a057ecd963f, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:42,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=74ee92c3cf25e92ef9b18a057ecd963f, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:42,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676283042481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283042481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283042481"}]},"ts":"1676283042481"} 2023-02-13 10:10:42,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 74ee92c3cf25e92ef9b18a057ecd963f, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:42,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:42,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74ee92c3cf25e92ef9b18a057ecd963f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 10:10:42,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:42,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,643 INFO [StoreOpener-74ee92c3cf25e92ef9b18a057ecd963f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,645 DEBUG [StoreOpener-74ee92c3cf25e92ef9b18a057ecd963f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:42,645 DEBUG [StoreOpener-74ee92c3cf25e92ef9b18a057ecd963f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:42,645 INFO [StoreOpener-74ee92c3cf25e92ef9b18a057ecd963f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74ee92c3cf25e92ef9b18a057ecd963f columnFamilyName family1 2023-02-13 10:10:42,647 INFO [StoreOpener-74ee92c3cf25e92ef9b18a057ecd963f-1] regionserver.HStore(310): Store=74ee92c3cf25e92ef9b18a057ecd963f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:42,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:10:42,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:42,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 74ee92c3cf25e92ef9b18a057ecd963f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67959857, jitterRate=0.012680783867835999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 10:10:42,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 74ee92c3cf25e92ef9b18a057ecd963f: Running coprocessor pre-open hook at 1676283042642Writing region info on filesystem at 1676283042642Initializing all the Stores at 1676283042643 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676283042643Cleaning up temporary data from old regions at 1676283042650 (+7 ms)Cleaning up detritus from prior splits at 1676283042650Running coprocessor post-open hooks at 1676283042654 (+4 ms)Region opened successfully at 1676283042654 2023-02-13 10:10:42,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., pid=114, masterSystemTime=1676283042638 2023-02-13 10:10:42,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:42,656 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=74ee92c3cf25e92ef9b18a057ecd963f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:42,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676283042656"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283042656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283042656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283042656"}]},"ts":"1676283042656"} 2023-02-13 10:10:42,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-13 10:10:42,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 74ee92c3cf25e92ef9b18a057ecd963f, server=jenkins-hbase16.apache.org,38311,1676282881622 in 173 msec 2023-02-13 10:10:42,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-13 10:10:42,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=74ee92c3cf25e92ef9b18a057ecd963f, ASSIGN in 332 msec 2023-02-13 10:10:42,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:10:42,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283042660"}]},"ts":"1676283042660"} 2023-02-13 10:10:42,661 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 10:10:42,669 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:10:42,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.2070 sec 2023-02-13 10:10:43,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 10:10:43,576 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-13 10:10:43,608 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:43,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,610 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:43,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:43,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:43,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:43,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,644 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:43,644 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:43,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:43,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:43,644 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:43,644 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:43,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:43,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,645 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:43,645 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:43,645 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:43,645 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:43,645 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:43,645 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:43,645 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:43,645 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:43,646 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 10:10:44,071 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130478360eb579846dc8688e04d6b9525c1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130478360eb579846dc8688e04d6b9525c1 2023-02-13 10:10:44,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/dcf6d2c997424e44b42a2fcbecf10585 2023-02-13 10:10:44,489 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/dcf6d2c997424e44b42a2fcbecf10585 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585 2023-02-13 10:10:44,493 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 10:10:44,494 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 848ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:44,494 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:44,495 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:44,495 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:44,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:44,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:44,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:44,495 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:44,527 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,527 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:44,528 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,528 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:44,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:44,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b765b8[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:44,532 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:44,533 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,543 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,543 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:44,543 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:44,543 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:44,543 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,544 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:44,552 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:44,552 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,552 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:44,553 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:44,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:44,563 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:44,563 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:44,563 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:44,563 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,563 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:44,569 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,569 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,569 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:44,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:44,570 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,573 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,584 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:44,584 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,584 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:44,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:44,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:44,584 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:44,584 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:44,584 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:44,585 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,585 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:44,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:44,585 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,585 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:44,585 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,586 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,686 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:44,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:44,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:44,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:44,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,693 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:44,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:44,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:44,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:44,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,693 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,702 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:44,702 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:44,702 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:44,702 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,703 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,703 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:44,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:44,703 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:44,703 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:44,703 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:44,703 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:44,703 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:44,703 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:44,703 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:44,703 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 10:10:45,114 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b7075cb70beb4f33b0e242b907924a72 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b7075cb70beb4f33b0e242b907924a72 2023-02-13 10:10:45,519 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/0997bab672c5485981ccc6d8c0b6be68 2023-02-13 10:10:45,524 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/0997bab672c5485981ccc6d8c0b6be68 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68 2023-02-13 10:10:45,528 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 10:10:45,529 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 826ms, sequenceid=9, compaction requested=false 2023-02-13 10:10:45,529 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:45,529 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:45,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:45,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:45,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:45,530 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:45,560 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,560 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:45,561 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,561 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:45,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:45,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f62ad46[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:45,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:45,566 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,576 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,576 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:45,577 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:45,577 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:45,577 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,577 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:45,585 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:45,586 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:45,586 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:45,585 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:45,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:45,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:45,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:45,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:45,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:45,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:45,596 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:45,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:45,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:45,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,596 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:45,602 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,602 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:45,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,602 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:45,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:45,603 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,605 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,644 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:45,644 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:45,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:45,644 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:45,644 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:45,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:45,644 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,645 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,645 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:45,645 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,645 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:45,645 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,646 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:45,646 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:45,746 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:45,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:45,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:45,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,761 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:45,761 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:45,761 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:45,761 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:45,762 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,762 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,777 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:45,777 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:45,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:45,778 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:45,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,780 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:45,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:45,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:45,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:45,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:45,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:45,782 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:45,782 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:45,782 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:45,782 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:46,204 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120126e36e8c500745eeb7bd08be3f5094db to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120126e36e8c500745eeb7bd08be3f5094db 2023-02-13 10:10:46,613 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/04e25880361c42faa0fdb2c88580fb9a 2023-02-13 10:10:46,625 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/04e25880361c42faa0fdb2c88580fb9a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a 2023-02-13 10:10:46,629 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 10:10:46,630 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 848ms, sequenceid=13, compaction requested=true 2023-02-13 10:10:46,630 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:46,630 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:46,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:46,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:46,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:46,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:46,660 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,660 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:46,661 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,661 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d8e9bea[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:46,663 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:46,663 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,668 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,669 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:46,669 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:46,669 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:46,669 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,669 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:46,677 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:46,677 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,677 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:46,677 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:46,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:46,683 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:46,683 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:46,683 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:46,683 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,683 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:46,694 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,694 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:46,694 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:46,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:46,695 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,699 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,710 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,710 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:46,710 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:46,710 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:46,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:46,711 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:46,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:46,711 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:46,712 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:46,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:46,812 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:46,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:46,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:46,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:46,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,826 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:46,826 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:46,826 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:46,826 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:46,827 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,827 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,835 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:46,835 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:46,836 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:46,836 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:46,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:46,839 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:46,839 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:46,839 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:46,840 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:46,840 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:46,840 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:46,840 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:46,840 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:46,857 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120530d40654cd2b402590f6a8f1e1d8ef54 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120530d40654cd2b402590f6a8f1e1d8ef54 2023-02-13 10:10:47,264 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/4642aebfaf1d4d0bba50e9423a1baa98 2023-02-13 10:10:47,269 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/4642aebfaf1d4d0bba50e9423a1baa98 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98 2023-02-13 10:10:47,273 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 10:10:47,273 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 433ms, sequenceid=17, compaction requested=true 2023-02-13 10:10:47,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:47,274 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:47,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:47,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:47,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:47,274 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:47,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,285 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:47,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,285 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:47,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:47,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51a387[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:47,288 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:47,288 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,294 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,294 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:47,294 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:47,294 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:47,294 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,294 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:47,302 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:47,302 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:47,302 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:47,302 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:47,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:47,309 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:47,309 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:47,309 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:47,309 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,309 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:47,319 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,319 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,319 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:47,320 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,323 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:47,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:47,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:47,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:47,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,335 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:47,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:47,336 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:47,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:47,436 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:47,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:47,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:47,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:47,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,449 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:47,449 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:47,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:47,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:47,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,450 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,460 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:47,460 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:47,461 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:47,462 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:47,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,464 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:47,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:47,464 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:47,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:47,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:47,465 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:47,465 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:47,465 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:47,465 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:47,883 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285837af2add6043508b2f6dbe4b629065 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285837af2add6043508b2f6dbe4b629065 2023-02-13 10:10:48,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:10:48,290 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/873b3936587b43cfa65a53e4276e7119 2023-02-13 10:10:48,294 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/873b3936587b43cfa65a53e4276e7119 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119 2023-02-13 10:10:48,298 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 10:10:48,298 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 833ms, sequenceid=21, compaction requested=true 2023-02-13 10:10:48,299 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:48,299 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:48,299 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:48,299 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:48,299 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,299 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:48,299 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:48,327 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,327 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:48,327 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,327 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:48,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:48,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79329c90[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:48,329 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:48,329 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,335 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,335 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:48,335 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:48,335 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,335 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:48,335 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:48,343 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:48,343 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,343 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:48,343 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:48,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:48,346 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:48,346 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:48,346 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:48,346 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,346 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:48,377 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,377 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,378 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:48,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:48,378 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,379 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:48,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:48,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,389 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:48,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:48,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:48,389 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,390 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:48,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:48,489 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:48,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:48,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:48,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:48,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,498 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:48,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:48,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:48,498 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:48,499 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,499 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,506 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:48,506 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:48,506 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:48,507 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:48,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:48,509 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:48,509 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:48,510 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:48,510 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:48,510 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:48,510 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:48,510 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:48,510 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:48,934 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e5d068f72d7740eb8a4467756b8a2bb8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5d068f72d7740eb8a4467756b8a2bb8 2023-02-13 10:10:49,341 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/f786bfdb3f8844eda85a9187f7bb37b2 2023-02-13 10:10:49,351 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/f786bfdb3f8844eda85a9187f7bb37b2 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2 2023-02-13 10:10:49,355 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 10:10:49,356 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 846ms, sequenceid=25, compaction requested=true 2023-02-13 10:10:49,356 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:49,356 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:49,356 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:49,356 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:49,356 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,356 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:49,356 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:49,364 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,364 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:49,365 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,365 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:49,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:49,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73b0166d[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:49,368 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:49,368 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,372 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,372 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:49,372 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:49,372 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:49,373 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,373 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:49,380 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:49,381 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,381 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:49,381 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:49,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:49,388 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:49,388 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:49,389 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:49,389 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,389 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:49,397 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,397 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:49,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:49,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,397 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:49,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:49,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:49,399 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:49,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:49,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,402 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:49,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:49,414 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:49,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:49,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:49,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:49,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:49,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:49,414 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,415 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:49,515 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:49,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:49,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,529 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:49,529 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:49,529 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:49,529 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:49,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,530 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,539 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:49,539 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:49,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:49,539 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:49,539 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:49,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:49,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,542 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:49,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:49,542 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:49,542 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:49,542 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:49,543 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:49,543 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:49,543 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:49,543 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:49,543 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:49,966 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101003fc5d30c8b4b88a3a6273c3832b523 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101003fc5d30c8b4b88a3a6273c3832b523 2023-02-13 10:10:50,374 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/6fc51396443a44b98d30df4c310edac4 2023-02-13 10:10:50,385 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/6fc51396443a44b98d30df4c310edac4 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4 2023-02-13 10:10:50,389 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 10:10:50,390 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 847ms, sequenceid=29, compaction requested=true 2023-02-13 10:10:50,390 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:50,390 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:50,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:50,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:50,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:50,390 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:50,422 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,422 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:50,423 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,423 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:50,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:50,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:50,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:50,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a78823a[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:50,428 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:50,429 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,439 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,439 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:50,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:50,440 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:50,440 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,440 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:50,447 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:50,447 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,447 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:50,448 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:50,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:50,458 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:50,459 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:50,459 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:50,459 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,459 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:50,471 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,471 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:50,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:50,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,471 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:50,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:50,473 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,477 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:50,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:50,489 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:50,490 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:50,489 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:50,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:50,490 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:50,490 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:50,590 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:50,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:50,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:50,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:50,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,602 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:50,602 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:50,602 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:50,602 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:50,602 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,602 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,613 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:50,613 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:50,613 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:50,613 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,614 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:50,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:50,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:50,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:50,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:50,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:50,614 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:50,614 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:50,615 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:50,615 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:51,034 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033af5ef404a764dd7a382d5993f140ccf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033af5ef404a764dd7a382d5993f140ccf 2023-02-13 10:10:51,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/dbfce0d919fd4bf89e2160a0ec184cdc 2023-02-13 10:10:51,454 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/dbfce0d919fd4bf89e2160a0ec184cdc as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc 2023-02-13 10:10:51,458 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 10:10:51,459 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 844ms, sequenceid=33, compaction requested=true 2023-02-13 10:10:51,459 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:51,459 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:51,459 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:51,459 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:51,459 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,459 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:51,460 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:51,497 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,497 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:51,498 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,498 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:51,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:51,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:51,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67b84969[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:51,503 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:51,503 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,514 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,514 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:51,515 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:51,515 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:51,515 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,515 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:51,540 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:51,540 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:51,541 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:51,541 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:51,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:51,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:51,551 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:51,551 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:51,551 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:51,551 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,551 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:51,564 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,564 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:51,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,564 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:51,565 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,568 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,580 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:51,581 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:51,580 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:51,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:51,581 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:51,581 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:51,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:51,581 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:51,581 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,582 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,582 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,582 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,582 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,582 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:51,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:51,682 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:51,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:51,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:51,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:51,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,696 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:51,696 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:51,696 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:51,696 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:51,697 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,697 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,705 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,705 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:51,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:51,706 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:51,706 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:51,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:51,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:51,710 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:51,710 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:51,711 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:52,136 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073c2c271346854ef481cb891e84946140 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509073c2c271346854ef481cb891e84946140 2023-02-13 10:10:52,546 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/0ec824cc3c424a68adeedf1808d93102 2023-02-13 10:10:52,559 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/0ec824cc3c424a68adeedf1808d93102 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102 2023-02-13 10:10:52,563 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 10:10:52,564 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 853ms, sequenceid=37, compaction requested=true 2023-02-13 10:10:52,564 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:52,564 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:52,564 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:52,564 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:52,565 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,565 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:52,565 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:52,572 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:52,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,572 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:52,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:52,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:52,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:52,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:52,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a038f12[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:52,575 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:52,575 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,580 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,581 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:52,581 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:52,581 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:52,581 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,581 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:52,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:52,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:52,589 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:52,589 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:52,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:52,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:52,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:52,596 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:52,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:52,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:52,596 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,596 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:52,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,606 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:52,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,605 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:52,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:52,607 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:52,610 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,622 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:52,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:52,623 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:52,622 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:52,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:52,622 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:52,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:52,623 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,624 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,623 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:52,624 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:52,624 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:52,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:52,724 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:52,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:52,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:52,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:52,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,738 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:52,738 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:52,738 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 10:10:52,739 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 10:10:52,739 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,739 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,747 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:52,747 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:52,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:52,748 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:52,748 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:52,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:52,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,750 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,751 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 10:10:52,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:52,751 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 10:10:52,751 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:52,751 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 10:10:52,751 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 10:10:52,751 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:52,751 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:52,752 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. started... 2023-02-13 10:10:52,752 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 74ee92c3cf25e92ef9b18a057ecd963f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 10:10:53,171 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112043b966c950f54f78b545d4e322c9a042 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112043b966c950f54f78b545d4e322c9a042 2023-02-13 10:10:53,579 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/99a6c766094345d59d78c5cec02b1bde 2023-02-13 10:10:53,592 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/99a6c766094345d59d78c5cec02b1bde as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde 2023-02-13 10:10:53,596 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 10:10:53,597 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 74ee92c3cf25e92ef9b18a057ecd963f in 845ms, sequenceid=41, compaction requested=true 2023-02-13 10:10:53,597 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:53,597 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:53,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 10:10:53,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 10:10:53,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 10:10:53,597 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 10:10:53,630 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,630 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:53,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:53,631 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:53,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 10:10:53,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f3f341[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:53,635 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 10:10:53,636 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,646 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,647 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 10:10:53,647 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 10:10:53,647 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:53,647 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,647 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:53,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 10:10:53,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:53,656 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 10:10:53,656 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:53,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:53,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:53,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:53,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 10:10:53,665 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 10:10:53,666 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:53,666 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:53,666 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,666 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:53,672 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,672 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,672 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:53,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:53,673 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,676 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,689 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:53,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 10:10:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:53,689 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:53,690 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:53,690 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:53,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:53,790 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:53,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:53,806 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-13 10:10:53,807 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:10:53,808 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:10:53,809 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:10:53,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283653809 2023-02-13 10:10:53,810 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 10:10:53,811 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 10:10:53,811 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:53,811 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x3457f986 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:10:53,822 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b65d6e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:10:53,823 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:54,245 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e24b3cd50edb4b2e802e97da109fe76d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e24b3cd50edb4b2e802e97da109fe76d 2023-02-13 10:10:54,246 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:54,259 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:10:54,260 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45252, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:10:54,265 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:10:54,266 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:10:54,274 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 first=Optional[r5] last=Optional[r6] 2023-02-13 10:10:54,275 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12d54bc6a2aa46d0bf1f068c8f105fc6}] 2023-02-13 10:10:54,279 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 for inclusion in 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 10:10:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:10:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:54,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qfffd4k7kn5o1fms4qsde9sbnrd01d62mbn8c7ul283io33dvvt7djhugere40hv/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 2023-02-13 10:10:54,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qfffd4k7kn5o1fms4qsde9sbnrd01d62mbn8c7ul283io33dvvt7djhugere40hv/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_ 2023-02-13 10:10:54,285 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qfffd4k7kn5o1fms4qsde9sbnrd01d62mbn8c7ul283io33dvvt7djhugere40hv/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 into 74ee92c3cf25e92ef9b18a057ecd963f/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_ - updating store file list. 2023-02-13 10:10:54,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_ into 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:54,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qfffd4k7kn5o1fms4qsde9sbnrd01d62mbn8c7ul283io33dvvt7djhugere40hv/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 into 74ee92c3cf25e92ef9b18a057ecd963f/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_) 2023-02-13 10:10:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qfffd4k7kn5o1fms4qsde9sbnrd01d62mbn8c7ul283io33dvvt7djhugere40hv/family1/12d54bc6a2aa46d0bf1f068c8f105fc6 2023-02-13 10:10:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 10:10:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 10:10:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(1912): 74ee92c3cf25e92ef9b18a057ecd963f/family1 is initiating minor compaction 2023-02-13 10:10:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4afe63c4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:54,290 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 74ee92c3cf25e92ef9b18a057ecd963f/family1 in testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:54,290 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp, totalSize=49.7 K 2023-02-13 10:10:54,290 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 0997bab672c5485981ccc6d8c0b6be68, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 04e25880361c42faa0fdb2c88580fb9a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 4642aebfaf1d4d0bba50e9423a1baa98, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 873b3936587b43cfa65a53e4276e7119, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting f786bfdb3f8844eda85a9187f7bb37b2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 6fc51396443a44b98d30df4c310edac4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting dbfce0d919fd4bf89e2160a0ec184cdc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 0ec824cc3c424a68adeedf1808d93102, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 99a6c766094345d59d78c5cec02b1bde, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 10:10:54,291 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 40cbbf186f9a4a948744ed47391a43e2_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 10:10:54,292 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:54,292 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:54,293 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101003fc5d30c8b4b88a3a6273c3832b523 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101003fc5d30c8b4b88a3a6273c3832b523 2023-02-13 10:10:54,294 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033af5ef404a764dd7a382d5993f140ccf to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033af5ef404a764dd7a382d5993f140ccf 2023-02-13 10:10:54,294 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 10:10:54,294 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 10:10:54,295 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:54,295 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:54,306 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 74ee92c3cf25e92ef9b18a057ecd963f#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:55,130 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123184addf9b0cee401e866216488eb55e93 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123184addf9b0cee401e866216488eb55e93 2023-02-13 10:10:55,130 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/89908ca07f4e482985c68bcbbde65069 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/89908ca07f4e482985c68bcbbde65069 2023-02-13 10:10:55,131 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:55,134 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 74ee92c3cf25e92ef9b18a057ecd963f/family1 of 74ee92c3cf25e92ef9b18a057ecd963f into 89908ca07f4e482985c68bcbbde65069(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:55,134 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:55,134 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676283054290; duration=0sec 2023-02-13 10:10:55,134 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:55,157 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7ef67e0d9684437ebb94caf1485cc921 first=Optional[r1] last=Optional[r4] 2023-02-13 10:10:55,158 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7ef67e0d9684437ebb94caf1485cc921}] 2023-02-13 10:10:55,160 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7ef67e0d9684437ebb94caf1485cc921 for inclusion in 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:55,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 10:10:55,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:10:55,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:55,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7ef67e0d9684437ebb94caf1485cc921 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__mdk6nghvvkd9bkqrb59j1k3igq2hukkufrru69sc8sel2t7a6pvqa47m8r7pjcbq/family1/7ef67e0d9684437ebb94caf1485cc921 2023-02-13 10:10:55,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__mdk6nghvvkd9bkqrb59j1k3igq2hukkufrru69sc8sel2t7a6pvqa47m8r7pjcbq/family1/7ef67e0d9684437ebb94caf1485cc921 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_ 2023-02-13 10:10:55,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__mdk6nghvvkd9bkqrb59j1k3igq2hukkufrru69sc8sel2t7a6pvqa47m8r7pjcbq/family1/7ef67e0d9684437ebb94caf1485cc921 into 74ee92c3cf25e92ef9b18a057ecd963f/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_ - updating store file list. 2023-02-13 10:10:55,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_ into 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:55,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__mdk6nghvvkd9bkqrb59j1k3igq2hukkufrru69sc8sel2t7a6pvqa47m8r7pjcbq/family1/7ef67e0d9684437ebb94caf1485cc921 into 74ee92c3cf25e92ef9b18a057ecd963f/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_) 2023-02-13 10:10:55,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__mdk6nghvvkd9bkqrb59j1k3igq2hukkufrru69sc8sel2t7a6pvqa47m8r7pjcbq/family1/7ef67e0d9684437ebb94caf1485cc921 2023-02-13 10:10:55,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 10:10:55,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 10:10:55,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(1912): 74ee92c3cf25e92ef9b18a057ecd963f/family1 is initiating minor compaction (all files) 2023-02-13 10:10:55,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@75592977; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:55,170 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 74ee92c3cf25e92ef9b18a057ecd963f/family1 in testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:10:55,171 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/89908ca07f4e482985c68bcbbde65069, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp, totalSize=178.1 K 2023-02-13 10:10:55,171 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting dcf6d2c997424e44b42a2fcbecf10585, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806172 2023-02-13 10:10:55,171 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 89908ca07f4e482985c68bcbbde65069, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206172 2023-02-13 10:10:55,171 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] compactions.Compactor(207): Compacting 4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206172 2023-02-13 10:10:55,172 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:55,172 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:55,174 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120126e36e8c500745eeb7bd08be3f5094db to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120126e36e8c500745eeb7bd08be3f5094db 2023-02-13 10:10:55,175 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120530d40654cd2b402590f6a8f1e1d8ef54 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120530d40654cd2b402590f6a8f1e1d8ef54 2023-02-13 10:10:55,176 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285837af2add6043508b2f6dbe4b629065 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285837af2add6043508b2f6dbe4b629065 2023-02-13 10:10:55,177 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5d068f72d7740eb8a4467756b8a2bb8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5d068f72d7740eb8a4467756b8a2bb8 2023-02-13 10:10:55,177 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 10:10:55,177 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 10:10:55,177 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:55,177 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:55,183 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] throttle.PressureAwareThroughputController(145): 74ee92c3cf25e92ef9b18a057ecd963f#family1#compaction#167 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 10:10:55,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_] to archive 2023-02-13 10:10:55,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:55,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0997bab672c5485981ccc6d8c0b6be68 2023-02-13 10:10:55,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/04e25880361c42faa0fdb2c88580fb9a 2023-02-13 10:10:55,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4642aebfaf1d4d0bba50e9423a1baa98 2023-02-13 10:10:55,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/873b3936587b43cfa65a53e4276e7119 2023-02-13 10:10:55,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/f786bfdb3f8844eda85a9187f7bb37b2 2023-02-13 10:10:55,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/6fc51396443a44b98d30df4c310edac4 2023-02-13 10:10:55,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dbfce0d919fd4bf89e2160a0ec184cdc 2023-02-13 10:10:55,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/0ec824cc3c424a68adeedf1808d93102 2023-02-13 10:10:55,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/99a6c766094345d59d78c5cec02b1bde 2023-02-13 10:10:55,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/40cbbf186f9a4a948744ed47391a43e2_SeqId_44_ 2023-02-13 10:10:55,622 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309d118876982445c2935eef75ecf21981 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511309d118876982445c2935eef75ecf21981 2023-02-13 10:10:55,623 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:55,649 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ee9710d5a36421a89abf27e7a48fdaa first=Optional[r00] last=Optional[r8] 2023-02-13 10:10:55,649 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ee9710d5a36421a89abf27e7a48fdaa}] 2023-02-13 10:10:55,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ee9710d5a36421a89abf27e7a48fdaa for inclusion in 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:55,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 10:10:55,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 10:10:55,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:55,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ee9710d5a36421a89abf27e7a48fdaa to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fq5uh1271ldn71atfj34280em6khlrvvu4kla6f30esn3lu0pabu3050es1fbn44/family1/9ee9710d5a36421a89abf27e7a48fdaa 2023-02-13 10:10:55,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fq5uh1271ldn71atfj34280em6khlrvvu4kla6f30esn3lu0pabu3050es1fbn44/family1/9ee9710d5a36421a89abf27e7a48fdaa as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/369254144e7c4d0784e5ec639794197e_SeqId_49_ 2023-02-13 10:10:55,656 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fq5uh1271ldn71atfj34280em6khlrvvu4kla6f30esn3lu0pabu3050es1fbn44/family1/9ee9710d5a36421a89abf27e7a48fdaa into 74ee92c3cf25e92ef9b18a057ecd963f/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/369254144e7c4d0784e5ec639794197e_SeqId_49_ - updating store file list. 2023-02-13 10:10:55,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/369254144e7c4d0784e5ec639794197e_SeqId_49_ into 74ee92c3cf25e92ef9b18a057ecd963f/family1 2023-02-13 10:10:55,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fq5uh1271ldn71atfj34280em6khlrvvu4kla6f30esn3lu0pabu3050es1fbn44/family1/9ee9710d5a36421a89abf27e7a48fdaa into 74ee92c3cf25e92ef9b18a057ecd963f/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/369254144e7c4d0784e5ec639794197e_SeqId_49_) 2023-02-13 10:10:55,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fq5uh1271ldn71atfj34280em6khlrvvu4kla6f30esn3lu0pabu3050es1fbn44/family1/9ee9710d5a36421a89abf27e7a48fdaa 2023-02-13 10:10:55,661 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:55,662 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:55,663 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112043b966c950f54f78b545d4e322c9a042 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112043b966c950f54f78b545d4e322c9a042 2023-02-13 10:10:55,665 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b7075cb70beb4f33b0e242b907924a72 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b7075cb70beb4f33b0e242b907924a72 2023-02-13 10:10:55,666 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130478360eb579846dc8688e04d6b9525c1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130478360eb579846dc8688e04d6b9525c1 2023-02-13 10:10:55,666 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 10:10:55,666 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 10:10:55,667 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:55,667 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:55,667 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 10:10:55,667 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 10:10:55,667 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:10:55,669 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 10:10:55,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8620 sec 2023-02-13 10:10:55,793 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252 (was 245) - Thread LEAK? -, OpenFileDescriptor=645 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=82 (was 88), ProcessCount=165 (was 165), AvailableMemoryMB=7657 (was 7664) 2023-02-13 10:10:55,802 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=82, ProcessCount=165, AvailableMemoryMB=7657 2023-02-13 10:10:55,819 DEBUG [Listener at localhost.localdomain/39579] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-13 10:10:55,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 10:10:55,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-13 10:10:55,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 10:10:55,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-13 10:10:55,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 10:10:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a empty. 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b empty. 2023-02-13 10:10:55,864 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b empty. 2023-02-13 10:10:55,865 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:55,865 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:55,865 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:55,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-13 10:10:55,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:56,010 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/.tmp/family1/ccbe0dce17a7402db178e8de59e23b83 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/ccbe0dce17a7402db178e8de59e23b83 2023-02-13 10:10:56,017 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 74ee92c3cf25e92ef9b18a057ecd963f/family1 of 74ee92c3cf25e92ef9b18a057ecd963f into ccbe0dce17a7402db178e8de59e23b83(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:10:56,017 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 74ee92c3cf25e92ef9b18a057ecd963f: 2023-02-13 10:10:56,017 INFO [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676283055170; duration=0sec 2023-02-13 10:10:56,017 DEBUG [RS:0;jenkins-hbase16:38311-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 10:10:56,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/89908ca07f4e482985c68bcbbde65069, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_] to archive 2023-02-13 10:10:56,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:10:56,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/dcf6d2c997424e44b42a2fcbecf10585 2023-02-13 10:10:56,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/89908ca07f4e482985c68bcbbde65069 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/89908ca07f4e482985c68bcbbde65069 2023-02-13 10:10:56,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_ to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/family1/4a05e43efdbe4eec89e3ead023e91c35_SeqId_47_ 2023-02-13 10:10:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:56,274 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-13 10:10:56,278 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => ff0cffc0193483c3f08a2f445595849a, NAME => 'testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:56,279 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => b9edb4a3c4d71f1ff09d06871e99ec1b, NAME => 'testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:56,280 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3a5cd0a3e9fc007920bb491a68f2767b, NAME => 'testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/.tmp 2023-02-13 10:10:56,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:56,690 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:56,690 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:56,690 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing b9edb4a3c4d71f1ff09d06871e99ec1b, disabling compactions & flushes 2023-02-13 10:10:56,691 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:56,691 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:56,691 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:56,691 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing ff0cffc0193483c3f08a2f445595849a, disabling compactions & flushes 2023-02-13 10:10:56,691 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 3a5cd0a3e9fc007920bb491a68f2767b, disabling compactions & flushes 2023-02-13 10:10:56,691 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. after waiting 0 ms 2023-02-13 10:10:56,692 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:56,692 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:56,692 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:56,692 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:56,693 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. after waiting 0 ms 2023-02-13 10:10:56,693 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:56,691 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:56,693 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:56,693 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 3a5cd0a3e9fc007920bb491a68f2767b: Waiting for close lock at 1676283056691Disabling compacts and flushes for region at 1676283056691Disabling writes for close at 1676283056693 (+2 ms)Writing region close event to WAL at 1676283056693Closed at 1676283056693 2023-02-13 10:10:56,692 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for b9edb4a3c4d71f1ff09d06871e99ec1b: Waiting for close lock at 1676283056690Disabling compacts and flushes for region at 1676283056690Disabling writes for close at 1676283056692 (+2 ms)Writing region close event to WAL at 1676283056692Closed at 1676283056692 2023-02-13 10:10:56,693 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:56,693 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. after waiting 0 ms 2023-02-13 10:10:56,694 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:56,694 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:56,694 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for ff0cffc0193483c3f08a2f445595849a: Waiting for close lock at 1676283056690Disabling compacts and flushes for region at 1676283056691 (+1 ms)Disabling writes for close at 1676283056694 (+3 ms)Writing region close event to WAL at 1676283056694Closed at 1676283056694 2023-02-13 10:10:56,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 10:10:56,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676283056731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283056731"}]},"ts":"1676283056731"} 2023-02-13 10:10:56,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283056731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283056731"}]},"ts":"1676283056731"} 2023-02-13 10:10:56,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283056731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676283056731"}]},"ts":"1676283056731"} 2023-02-13 10:10:56,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 10:10:56,737 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 10:10:56,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283056737"}]},"ts":"1676283056737"} 2023-02-13 10:10:56,740 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-13 10:10:56,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ff0cffc0193483c3f08a2f445595849a, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3a5cd0a3e9fc007920bb491a68f2767b, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9edb4a3c4d71f1ff09d06871e99ec1b, ASSIGN}] 2023-02-13 10:10:56,804 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9edb4a3c4d71f1ff09d06871e99ec1b, ASSIGN 2023-02-13 10:10:56,804 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3a5cd0a3e9fc007920bb491a68f2767b, ASSIGN 2023-02-13 10:10:56,804 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ff0cffc0193483c3f08a2f445595849a, ASSIGN 2023-02-13 10:10:56,805 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9edb4a3c4d71f1ff09d06871e99ec1b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:56,805 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3a5cd0a3e9fc007920bb491a68f2767b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:56,806 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ff0cffc0193483c3f08a2f445595849a, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,38311,1676282881622; forceNewPlan=false, retain=false 2023-02-13 10:10:56,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=b9edb4a3c4d71f1ff09d06871e99ec1b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:56,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ff0cffc0193483c3f08a2f445595849a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:56,957 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3a5cd0a3e9fc007920bb491a68f2767b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:56,958 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283056957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283056957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283056957"}]},"ts":"1676283056957"} 2023-02-13 10:10:56,958 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676283056957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283056957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283056957"}]},"ts":"1676283056957"} 2023-02-13 10:10:56,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283056957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676283056957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676283056957"}]},"ts":"1676283056957"} 2023-02-13 10:10:56,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure ff0cffc0193483c3f08a2f445595849a, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:56,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 3a5cd0a3e9fc007920bb491a68f2767b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:56,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure b9edb4a3c4d71f1ff09d06871e99ec1b, server=jenkins-hbase16.apache.org,38311,1676282881622}] 2023-02-13 10:10:56,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:57,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a5cd0a3e9fc007920bb491a68f2767b, NAME => 'testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 10:10:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,143 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,145 DEBUG [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1 2023-02-13 10:10:57,145 DEBUG [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1 2023-02-13 10:10:57,145 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a5cd0a3e9fc007920bb491a68f2767b columnFamilyName family1 2023-02-13 10:10:57,146 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] regionserver.HStore(310): Store=3a5cd0a3e9fc007920bb491a68f2767b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,146 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,147 DEBUG [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2 2023-02-13 10:10:57,148 DEBUG [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2 2023-02-13 10:10:57,148 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a5cd0a3e9fc007920bb491a68f2767b columnFamilyName family2 2023-02-13 10:10:57,149 INFO [StoreOpener-3a5cd0a3e9fc007920bb491a68f2767b-1] regionserver.HStore(310): Store=3a5cd0a3e9fc007920bb491a68f2767b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:57,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:10:57,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:57,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 3a5cd0a3e9fc007920bb491a68f2767b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69707334, jitterRate=0.03872022032737732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:57,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 3a5cd0a3e9fc007920bb491a68f2767b: Running coprocessor pre-open hook at 1676283057119Writing region info on filesystem at 1676283057119Initializing all the Stores at 1676283057121 (+2 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057121Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057121Cleaning up temporary data from old regions at 1676283057151 (+30 ms)Cleaning up detritus from prior splits at 1676283057151Running coprocessor post-open hooks at 1676283057154 (+3 ms)Region opened successfully at 1676283057154 2023-02-13 10:10:57,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b., pid=121, masterSystemTime=1676283057112 2023-02-13 10:10:57,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:57,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:57,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:57,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9edb4a3c4d71f1ff09d06871e99ec1b, NAME => 'testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 10:10:57,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3a5cd0a3e9fc007920bb491a68f2767b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:57,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676283057156"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283057156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283057156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283057156"}]},"ts":"1676283057156"} 2023-02-13 10:10:57,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:57,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-13 10:10:57,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 3a5cd0a3e9fc007920bb491a68f2767b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 197 msec 2023-02-13 10:10:57,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3a5cd0a3e9fc007920bb491a68f2767b, ASSIGN in 358 msec 2023-02-13 10:10:57,172 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,174 DEBUG [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1 2023-02-13 10:10:57,174 DEBUG [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1 2023-02-13 10:10:57,174 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9edb4a3c4d71f1ff09d06871e99ec1b columnFamilyName family1 2023-02-13 10:10:57,174 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] regionserver.HStore(310): Store=b9edb4a3c4d71f1ff09d06871e99ec1b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,175 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,175 DEBUG [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2 2023-02-13 10:10:57,175 DEBUG [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2 2023-02-13 10:10:57,176 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9edb4a3c4d71f1ff09d06871e99ec1b columnFamilyName family2 2023-02-13 10:10:57,176 INFO [StoreOpener-b9edb4a3c4d71f1ff09d06871e99ec1b-1] regionserver.HStore(310): Store=b9edb4a3c4d71f1ff09d06871e99ec1b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:57,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:10:57,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:57,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened b9edb4a3c4d71f1ff09d06871e99ec1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70245254, jitterRate=0.04673585295677185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:57,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for b9edb4a3c4d71f1ff09d06871e99ec1b: Running coprocessor pre-open hook at 1676283057156Writing region info on filesystem at 1676283057156Initializing all the Stores at 1676283057157 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057157Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057157Cleaning up temporary data from old regions at 1676283057177 (+20 ms)Cleaning up detritus from prior splits at 1676283057177Running coprocessor post-open hooks at 1676283057180 (+3 ms)Region opened successfully at 1676283057180 2023-02-13 10:10:57,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b., pid=122, masterSystemTime=1676283057112 2023-02-13 10:10:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:57,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:57,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff0cffc0193483c3f08a2f445595849a, NAME => 'testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 10:10:57,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=b9edb4a3c4d71f1ff09d06871e99ec1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283057182"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283057182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283057182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283057182"}]},"ts":"1676283057182"} 2023-02-13 10:10:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 10:10:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-13 10:10:57,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure b9edb4a3c4d71f1ff09d06871e99ec1b, server=jenkins-hbase16.apache.org,38311,1676282881622 in 222 msec 2023-02-13 10:10:57,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9edb4a3c4d71f1ff09d06871e99ec1b, ASSIGN in 385 msec 2023-02-13 10:10:57,200 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,201 DEBUG [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1 2023-02-13 10:10:57,201 DEBUG [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1 2023-02-13 10:10:57,201 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0cffc0193483c3f08a2f445595849a columnFamilyName family1 2023-02-13 10:10:57,202 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] regionserver.HStore(310): Store=ff0cffc0193483c3f08a2f445595849a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,202 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,203 DEBUG [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2 2023-02-13 10:10:57,203 DEBUG [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2 2023-02-13 10:10:57,203 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0cffc0193483c3f08a2f445595849a columnFamilyName family2 2023-02-13 10:10:57,204 INFO [StoreOpener-ff0cffc0193483c3f08a2f445595849a-1] regionserver.HStore(310): Store=ff0cffc0193483c3f08a2f445595849a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 10:10:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 10:10:57,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:10:57,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 10:10:57,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened ff0cffc0193483c3f08a2f445595849a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66132265, jitterRate=-0.014552459120750427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 10:10:57,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for ff0cffc0193483c3f08a2f445595849a: Running coprocessor pre-open hook at 1676283057183Writing region info on filesystem at 1676283057183Initializing all the Stores at 1676283057183Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057183Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676283057183Cleaning up temporary data from old regions at 1676283057205 (+22 ms)Cleaning up detritus from prior splits at 1676283057205Running coprocessor post-open hooks at 1676283057208 (+3 ms)Region opened successfully at 1676283057208 2023-02-13 10:10:57,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a., pid=120, masterSystemTime=1676283057112 2023-02-13 10:10:57,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:57,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:57,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ff0cffc0193483c3f08a2f445595849a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:57,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676283057210"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676283057210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676283057210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676283057210"}]},"ts":"1676283057210"} 2023-02-13 10:10:57,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-13 10:10:57,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure ff0cffc0193483c3f08a2f445595849a, server=jenkins-hbase16.apache.org,38311,1676282881622 in 252 msec 2023-02-13 10:10:57,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-02-13 10:10:57,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ff0cffc0193483c3f08a2f445595849a, ASSIGN in 412 msec 2023-02-13 10:10:57,213 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 10:10:57,213 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676283057213"}]},"ts":"1676283057213"} 2023-02-13 10:10:57,214 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-13 10:10:57,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 10:10:57,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3620 sec 2023-02-13 10:10:57,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 10:10:57,972 INFO [Listener at localhost.localdomain/39579] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-13 10:10:57,982 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:57,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:57,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:57,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:57,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 10:10:57,987 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 10:10:57,987 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:57,987 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 10:10:57,987 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 10:10:57,988 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:57,988 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:58,022 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:58,022 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:58,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:58,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:58,022 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:58,022 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:58,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:58,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 10:10:58,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 10:10:58,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 10:10:58,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:58,024 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 10:10:58,024 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:58,024 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. started... 2023-02-13 10:10:58,024 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:58,025 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:58,025 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:58,025 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff0cffc0193483c3f08a2f445595849a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:58,025 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. started... 2023-02-13 10:10:58,026 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:58,026 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. started... 2023-02-13 10:10:58,026 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9edb4a3c4d71f1ff09d06871e99ec1b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:58,027 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a5cd0a3e9fc007920bb491a68f2767b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 10:10:58,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c21454f4e289497dbe984a395c2ceed7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213c21454f4e289497dbe984a395c2ceed7 2023-02-13 10:10:58,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213fd9a03fc2a894cf585fc7e54f3d2f96b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213fd9a03fc2a894cf585fc7e54f3d2f96b 2023-02-13 10:10:58,477 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213972e510eb33449ccafebb38948f5dbc2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213972e510eb33449ccafebb38948f5dbc2 2023-02-13 10:10:58,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 10:10:58,890 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/1400fd3bbc3b4f08b47f1f68c109d7ec 2023-02-13 10:10:58,895 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/8390d70f7f5e46c5bc6945dc7f622365 2023-02-13 10:10:58,895 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/b0d079ff5f014238aec147439e1b0629 2023-02-13 10:10:59,338 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213e844bbc38fc149f085b66f78c1959a1b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213e844bbc38fc149f085b66f78c1959a1b 2023-02-13 10:10:59,342 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021392bfb9a15ce8493fad0d96d723f5cb2b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021392bfb9a15ce8493fad0d96d723f5cb2b 2023-02-13 10:10:59,342 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021347fc400d0fc34131b03f9c8ef2cfdf04 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021347fc400d0fc34131b03f9c8ef2cfdf04 2023-02-13 10:10:59,345 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/395b0a9262664115abc6eb9b00d48679 2023-02-13 10:10:59,349 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/b0d079ff5f014238aec147439e1b0629 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629 2023-02-13 10:10:59,367 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 10:10:59,367 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/395b0a9262664115abc6eb9b00d48679 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679 2023-02-13 10:10:59,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:59,371 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ff0cffc0193483c3f08a2f445595849a in 1346ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:59,372 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:10:59,372 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:59,372 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:10:59,748 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/8957ea79a7fd4486b9cebff3844c1dd9 2023-02-13 10:10:59,749 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/14602baadfe0445c95ddfc92b0aa6518 2023-02-13 10:10:59,759 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/8390d70f7f5e46c5bc6945dc7f622365 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365 2023-02-13 10:10:59,759 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/1400fd3bbc3b4f08b47f1f68c109d7ec as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec 2023-02-13 10:10:59,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 10:10:59,784 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 10:10:59,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/14602baadfe0445c95ddfc92b0aa6518 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518 2023-02-13 10:10:59,785 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/8957ea79a7fd4486b9cebff3844c1dd9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9 2023-02-13 10:10:59,787 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:59,787 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 10:10:59,788 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3a5cd0a3e9fc007920bb491a68f2767b in 1761ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:59,788 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b9edb4a3c4d71f1ff09d06871e99ec1b in 1762ms, sequenceid=5, compaction requested=false 2023-02-13 10:10:59,788 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:10:59,788 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:10:59,788 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:59,788 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 10:10:59,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 10:10:59,822 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,822 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:59,822 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,822 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:59,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 10:10:59,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b4d717[Count = 0] remaining members to acquire global barrier 2023-02-13 10:10:59,826 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 10:10:59,826 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,830 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,831 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 10:10:59,831 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 10:10:59,831 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,831 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:10:59,831 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:10:59,838 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 10:10:59,839 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,839 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:59,839 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 10:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:10:59,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 10:10:59,847 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 10:10:59,847 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:10:59,847 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:10:59,847 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 10:10:59,847 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:10:59,855 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,855 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,855 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:10:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:10:59,856 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:10:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:10:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,859 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:10:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:10:59,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,872 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,872 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:10:59,873 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 10:10:59,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:10:59,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 10:10:59,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:59,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:59,873 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 10:10:59,873 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:10:59,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:10:59,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:10:59,974 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:10:59,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:10:59,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:59,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:59,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:10:59,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:10:59,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 10:10:59,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 10:10:59,980 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 10:10:59,980 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:59,980 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 10:10:59,980 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 10:10:59,980 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,980 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:59,988 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:10:59,988 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:10:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:10:59,989 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:10:59,989 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:10:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:59,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:10:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:10:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:10:59,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 10:10:59,990 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 10:10:59,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 10:10:59,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 10:10:59,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:10:59,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. started... 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:10:59,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:10:59,990 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. started... 2023-02-13 10:10:59,990 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. started... 2023-02-13 10:10:59,990 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff0cffc0193483c3f08a2f445595849a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:10:59,990 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9edb4a3c4d71f1ff09d06871e99ec1b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:10:59,990 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a5cd0a3e9fc007920bb491a68f2767b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 10:11:00,436 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134aed38b03bb04e0081f9e1c1d9802d48 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134aed38b03bb04e0081f9e1c1d9802d48 2023-02-13 10:11:00,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139bb566dce3f44518b9b23b4494473ff0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139bb566dce3f44518b9b23b4494473ff0 2023-02-13 10:11:00,442 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302131cf3ceeca7984603a08fed8c35f588af to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302131cf3ceeca7984603a08fed8c35f588af 2023-02-13 10:11:00,851 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/b66a4db9995b40169fe9e2c7b8b60284 2023-02-13 10:11:00,855 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/2d711cc914dc4f279a989b44f5301caa 2023-02-13 10:11:00,857 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/585b9040164d40efba0bd575e7f1e39e 2023-02-13 10:11:01,296 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021364ba596475b141dca812deea0ee9d857 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021364ba596475b141dca812deea0ee9d857 2023-02-13 10:11:01,302 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/00e17ac29362456b8b96e292060d8f0e 2023-02-13 10:11:01,302 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131c5c2478d25c48148be12229d2d1ed4d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302131c5c2478d25c48148be12229d2d1ed4d 2023-02-13 10:11:01,302 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130185cba85dba492e82f71720320e32d9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302130185cba85dba492e82f71720320e32d9 2023-02-13 10:11:01,307 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/2d711cc914dc4f279a989b44f5301caa as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa 2023-02-13 10:11:01,308 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/306531b2615e46798ef153b161301529 2023-02-13 10:11:01,311 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/b66a4db9995b40169fe9e2c7b8b60284 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284 2023-02-13 10:11:01,328 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 10:11:01,329 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/00e17ac29362456b8b96e292060d8f0e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e 2023-02-13 10:11:01,330 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 10:11:01,330 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/306531b2615e46798ef153b161301529 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529 2023-02-13 10:11:01,332 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:11:01,332 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3a5cd0a3e9fc007920bb491a68f2767b in 1342ms, sequenceid=9, compaction requested=false 2023-02-13 10:11:01,333 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:01,333 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:01,333 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:11:01,333 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:11:01,334 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ff0cffc0193483c3f08a2f445595849a in 1343ms, sequenceid=9, compaction requested=false 2023-02-13 10:11:01,334 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:01,334 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:01,334 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:11:01,709 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/dacbdd9c1e43410f9cdf2c246ad299a1 2023-02-13 10:11:01,721 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/585b9040164d40efba0bd575e7f1e39e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e 2023-02-13 10:11:01,742 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 10:11:01,743 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/dacbdd9c1e43410f9cdf2c246ad299a1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1 2023-02-13 10:11:01,747 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 10:11:01,748 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b9edb4a3c4d71f1ff09d06871e99ec1b in 1758ms, sequenceid=9, compaction requested=false 2023-02-13 10:11:01,748 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:01,748 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:01,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:11:01,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:11:01,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 10:11:01,748 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 10:11:01,780 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:01,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,781 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:11:01,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:01,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:01,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:01,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 10:11:01,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e23f89[Count = 0] remaining members to acquire global barrier 2023-02-13 10:11:01,784 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 10:11:01,784 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,789 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 10:11:01,789 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 10:11:01,789 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:11:01,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,789 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:11:01,797 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 10:11:01,797 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:01,797 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 10:11:01,797 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:11:01,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 10:11:01,805 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 10:11:01,805 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:11:01,805 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:11:01,805 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 10:11:01,805 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:11:01,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,814 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:01,813 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:01,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,815 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,818 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:01,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:01,847 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:01,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:01,848 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:01,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 10:11:01,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:11:01,848 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:01,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 10:11:01,848 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:01,849 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,849 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 10:11:01,849 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:11:01,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:01,950 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:11:01,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:11:01,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:01,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:01,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:01,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:11:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 10:11:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 10:11:01,964 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 10:11:01,964 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:01,965 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 10:11:01,965 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 10:11:01,966 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,966 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:01,972 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:01,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:01,972 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:01,973 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:01,973 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:11:01,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:11:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:01,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 10:11:01,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 10:11:01,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 10:11:01,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 10:11:01,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:01,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 10:11:01,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:01,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. started... 2023-02-13 10:11:01,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:01,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. started... 2023-02-13 10:11:01,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:11:01,977 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:11:01,976 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff0cffc0193483c3f08a2f445595849a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:11:01,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:01,977 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. started... 2023-02-13 10:11:01,977 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9edb4a3c4d71f1ff09d06871e99ec1b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:11:01,977 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a5cd0a3e9fc007920bb491a68f2767b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 10:11:02,428 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d9c8ee93f3444390a90af05266f15752 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213d9c8ee93f3444390a90af05266f15752 2023-02-13 10:11:02,428 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213510e6a352b2d432b9b0955e8702fb28d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213510e6a352b2d432b9b0955e8702fb28d 2023-02-13 10:11:02,429 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134abc24aa4d724a5d88a07d2ea6500290 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134abc24aa4d724a5d88a07d2ea6500290 2023-02-13 10:11:02,440 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/75c68d7741ef46b1a4c6f53923b34da7 2023-02-13 10:11:02,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 10:11:02,840 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/262f4823d48246059c2292b51be8050c 2023-02-13 10:11:02,840 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/8b75a423faf84aae82b26ad3c14f8b1d 2023-02-13 10:11:02,868 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213779ee559437b468a8413f0474e1e0b00 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213779ee559437b468a8413f0474e1e0b00 2023-02-13 10:11:03,273 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/5837443ca2a649da833e14a462cf4e11 2023-02-13 10:11:03,281 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021302af796ba709480692ccf10b8694250d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021302af796ba709480692ccf10b8694250d 2023-02-13 10:11:03,281 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136a00d6dde26748ffaef85d04b145913a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302136a00d6dde26748ffaef85d04b145913a 2023-02-13 10:11:03,282 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/75c68d7741ef46b1a4c6f53923b34da7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7 2023-02-13 10:11:03,288 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/467fa73589a943efaef2ba939c0a88d7 2023-02-13 10:11:03,291 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/8b75a423faf84aae82b26ad3c14f8b1d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d 2023-02-13 10:11:03,303 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 10:11:03,304 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/5837443ca2a649da833e14a462cf4e11 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11 2023-02-13 10:11:03,307 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:11:03,308 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3a5cd0a3e9fc007920bb491a68f2767b in 1331ms, sequenceid=13, compaction requested=true 2023-02-13 10:11:03,308 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:03,308 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:03,308 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:11:03,311 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 10:11:03,312 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/467fa73589a943efaef2ba939c0a88d7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7 2023-02-13 10:11:03,315 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:11:03,316 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b9edb4a3c4d71f1ff09d06871e99ec1b in 1339ms, sequenceid=13, compaction requested=true 2023-02-13 10:11:03,316 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:03,316 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:03,316 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:11:03,687 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/ff8d1c35beee415baccb62494ca1396d 2023-02-13 10:11:03,698 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/262f4823d48246059c2292b51be8050c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c 2023-02-13 10:11:03,720 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 10:11:03,720 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/ff8d1c35beee415baccb62494ca1396d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d 2023-02-13 10:11:03,724 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 10:11:03,724 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ff0cffc0193483c3f08a2f445595849a in 1748ms, sequenceid=13, compaction requested=true 2023-02-13 10:11:03,724 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:03,724 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:03,724 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:11:03,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:11:03,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 10:11:03,725 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 10:11:03,771 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,771 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:03,772 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,772 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:03,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 10:11:03,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@648f55d8[Count = 0] remaining members to acquire global barrier 2023-02-13 10:11:03,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 10:11:03,775 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,780 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 10:11:03,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 10:11:03,780 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:11:03,780 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,780 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:11:03,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 10:11:03,788 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:03,788 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 10:11:03,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:11:03,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 10:11:03,795 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 10:11:03,795 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:11:03,795 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:11:03,795 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 10:11:03,795 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:11:03,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:03,805 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:03,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:03,807 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,810 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:03,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:03,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 10:11:03,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:11:03,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:03,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:03,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 10:11:03,844 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 10:11:03,843 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:03,843 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:03,844 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:03,844 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:11:03,844 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,845 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:03,845 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,945 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:11:03,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:11:03,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:03,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:03,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 10:11:03,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:11:03,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 10:11:03,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 10:11:03,960 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 10:11:03,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:03,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 10:11:03,960 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 10:11:03,961 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,961 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:03,972 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:03,972 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:03,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:03,973 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:03,973 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:11:03,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:03,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:03,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:11:03,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:03,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 10:11:03,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 10:11:03,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 10:11:03,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 10:11:03,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:03,975 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. started... 2023-02-13 10:11:03,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:11:03,976 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. started... 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:03,976 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. started... 2023-02-13 10:11:03,976 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a5cd0a3e9fc007920bb491a68f2767b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:11:03,977 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9edb4a3c4d71f1ff09d06871e99ec1b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:11:03,976 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff0cffc0193483c3f08a2f445595849a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 10:11:04,018 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213993ade37631547ac921456ee3790628e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213993ade37631547ac921456ee3790628e 2023-02-13 10:11:04,426 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021361504d242d144b498f16885d2e724e70 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361504d242d144b498f16885d2e724e70 2023-02-13 10:11:04,430 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/dcd10e81bd38497e962cf27142bf6d51 2023-02-13 10:11:04,434 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213700b7ad4650743ecaa2c78f7a1794e2d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213700b7ad4650743ecaa2c78f7a1794e2d 2023-02-13 10:11:04,443 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/b31c955420ad4117b617d2f4972f1b6c 2023-02-13 10:11:04,847 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/3f14befc07e74a6a8a7ecabfb993e952 2023-02-13 10:11:04,863 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213cbb6f23891f44be2a95a90e53063fa8c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213cbb6f23891f44be2a95a90e53063fa8c 2023-02-13 10:11:04,876 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130dff4a18b28a4a70b5d681585ab2beb2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302130dff4a18b28a4a70b5d681585ab2beb2 2023-02-13 10:11:04,888 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131eee29b8162f4b0eadfe36947c7a1f68 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302131eee29b8162f4b0eadfe36947c7a1f68 2023-02-13 10:11:05,268 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/6ba015ab033e4b03abd8e2a093296075 2023-02-13 10:11:05,279 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/dcd10e81bd38497e962cf27142bf6d51 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51 2023-02-13 10:11:05,286 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/89c9453ab2414cb78a735a24c9979f55 2023-02-13 10:11:05,292 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/b31c955420ad4117b617d2f4972f1b6c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c 2023-02-13 10:11:05,293 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/0eb46f39d945410d9e00fcb4b65e9014 2023-02-13 10:11:05,298 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/3f14befc07e74a6a8a7ecabfb993e952 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952 2023-02-13 10:11:05,307 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 10:11:05,307 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/6ba015ab033e4b03abd8e2a093296075 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075 2023-02-13 10:11:05,311 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:11:05,311 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b9edb4a3c4d71f1ff09d06871e99ec1b in 1334ms, sequenceid=17, compaction requested=true 2023-02-13 10:11:05,311 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:05,312 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:05,312 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:11:05,317 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 10:11:05,318 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/0eb46f39d945410d9e00fcb4b65e9014 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014 2023-02-13 10:11:05,318 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 10:11:05,319 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/89c9453ab2414cb78a735a24c9979f55 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55 2023-02-13 10:11:05,322 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:11:05,322 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 10:11:05,323 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3a5cd0a3e9fc007920bb491a68f2767b in 1347ms, sequenceid=17, compaction requested=true 2023-02-13 10:11:05,323 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ff0cffc0193483c3f08a2f445595849a in 1347ms, sequenceid=17, compaction requested=true 2023-02-13 10:11:05,323 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:05,323 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:05,323 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:05,323 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 10:11:05,323 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 10:11:05,355 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,355 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:05,355 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,355 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:11:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:05,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 10:11:05,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@280cbf3[Count = 0] remaining members to acquire global barrier 2023-02-13 10:11:05,357 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 10:11:05,357 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,363 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,363 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 10:11:05,363 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 10:11:05,363 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:11:05,363 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,363 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:11:05,371 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 10:11:05,371 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:05,371 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,371 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 10:11:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:05,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:05,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:11:05,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 10:11:05,377 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 10:11:05,377 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:11:05,377 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:11:05,377 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 10:11:05,377 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:11:05,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,388 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:05,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:05,390 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,393 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:05,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:05,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 10:11:05,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:11:05,405 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:11:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:05,405 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:05,406 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:05,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:05,506 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:11:05,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:11:05,523 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:05,529 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:05,540 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:05,541 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:05,561 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:11:05,561 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c8e3c57 to 127.0.0.1:57475 2023-02-13 10:11:05,561 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:05,561 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:11:05,561 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3457f986 to 127.0.0.1:57475 2023-02-13 10:11:05,561 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:05,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 10:11:05,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 10:11:05,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 10:11:05,652 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 10:11:05,652 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:05,653 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 10:11:05,653 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 10:11:05,653 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,653 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:05,663 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:05,663 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:05,663 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:05,663 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 10:11:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:05,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 10:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:05,664 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 10:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 10:11:05,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 10:11:05,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 10:11:05,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 10:11:05,664 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:05,664 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. started... 2023-02-13 10:11:05,664 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:05,664 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 10:11:05,665 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff0cffc0193483c3f08a2f445595849a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:11:05,665 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:05,665 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. started... 2023-02-13 10:11:05,665 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. started... 2023-02-13 10:11:05,665 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 10:11:05,665 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a5cd0a3e9fc007920bb491a68f2767b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:11:05,665 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9edb4a3c4d71f1ff09d06871e99ec1b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 10:11:06,100 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/d53e952ba42b4690b9488d8e9f50a57a 2023-02-13 10:11:06,119 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d53e952ba42b4690b9488d8e9f50a57a 2023-02-13 10:11:06,511 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/a39cf8c40b024a63a1bac0c2383bcb3d 2023-02-13 10:11:06,515 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/680e4ec90c714d2d8252a10b7a22b6ea 2023-02-13 10:11:06,531 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/493c144cf00042ed9aa6577f9ddaf32c 2023-02-13 10:11:06,534 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 493c144cf00042ed9aa6577f9ddaf32c 2023-02-13 10:11:06,534 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/d53e952ba42b4690b9488d8e9f50a57a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a 2023-02-13 10:11:06,540 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a39cf8c40b024a63a1bac0c2383bcb3d 2023-02-13 10:11:06,540 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 680e4ec90c714d2d8252a10b7a22b6ea 2023-02-13 10:11:06,554 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d53e952ba42b4690b9488d8e9f50a57a 2023-02-13 10:11:06,554 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 10:11:06,555 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/493c144cf00042ed9aa6577f9ddaf32c as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c 2023-02-13 10:11:06,558 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 493c144cf00042ed9aa6577f9ddaf32c 2023-02-13 10:11:06,558 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:11:06,559 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3a5cd0a3e9fc007920bb491a68f2767b in 894ms, sequenceid=23, compaction requested=true 2023-02-13 10:11:06,559 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:06,559 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:06,559 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 10:11:06,958 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/0fc2c03136ad431c8b5bd3f849ea94bd 2023-02-13 10:11:06,962 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/b8832d17444b48fc8326116edc982eb0 2023-02-13 10:11:06,964 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fc2c03136ad431c8b5bd3f849ea94bd 2023-02-13 10:11:06,965 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/680e4ec90c714d2d8252a10b7a22b6ea as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea 2023-02-13 10:11:06,966 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8832d17444b48fc8326116edc982eb0 2023-02-13 10:11:06,967 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/a39cf8c40b024a63a1bac0c2383bcb3d as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d 2023-02-13 10:11:06,987 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 680e4ec90c714d2d8252a10b7a22b6ea 2023-02-13 10:11:06,988 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 10:11:06,988 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a39cf8c40b024a63a1bac0c2383bcb3d 2023-02-13 10:11:06,988 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/0fc2c03136ad431c8b5bd3f849ea94bd as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd 2023-02-13 10:11:06,988 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 10:11:06,989 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/b8832d17444b48fc8326116edc982eb0 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0 2023-02-13 10:11:06,992 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8832d17444b48fc8326116edc982eb0 2023-02-13 10:11:06,992 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fc2c03136ad431c8b5bd3f849ea94bd 2023-02-13 10:11:06,992 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:11:06,992 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 10:11:06,993 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ff0cffc0193483c3f08a2f445595849a in 1328ms, sequenceid=23, compaction requested=true 2023-02-13 10:11:06,993 INFO [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b9edb4a3c4d71f1ff09d06871e99ec1b in 1328ms, sequenceid=23, compaction requested=true 2023-02-13 10:11:06,993 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:06,993 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:06,993 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:06,993 DEBUG [rs(jenkins-hbase16.apache.org,38311,1676282881622)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 10:11:06,993 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 10:11:07,030 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,030 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:07,030 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,030 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 10:11:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:07,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,38311,1676282881622' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 10:11:07,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73fda8db[Count = 0] remaining members to acquire global barrier 2023-02-13 10:11:07,033 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 10:11:07,033 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,038 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,038 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 10:11:07,038 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 10:11:07,038 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,38311,1676282881622' in zk 2023-02-13 10:11:07,038 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,038 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 10:11:07,046 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 10:11:07,046 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:07,046 DEBUG [member: 'jenkins-hbase16.apache.org,38311,1676282881622' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 10:11:07,046 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:07,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:07,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,38311,1676282881622': 2023-02-13 10:11:07,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,38311,1676282881622' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 10:11:07,051 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 10:11:07,051 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 10:11:07,051 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 10:11:07,051 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 10:11:07,052 INFO [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 10:11:07,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,063 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 10:11:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 10:11:07,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:07,064 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 10:11:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 10:11:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,066 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 10:11:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 10:11:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 10:11:07,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:07,079 DEBUG [(jenkins-hbase16.apache.org,42277,1676282880018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 10:11:07,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 10:11:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 10:11:07,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 10:11:07,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 10:11:07,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 10:11:07,079 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 10:11:07,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 10:11:07,080 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:07,080 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 10:11:07,080 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 10:11:07,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 10:11:07,080 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 10:11:07,080 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 10:11:07,081 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 10:11:07,181 DEBUG [Listener at localhost.localdomain/39579] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 10:11:07,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 10:11:07,184 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:07,184 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): ff0cffc0193483c3f08a2f445595849a/family1 is initiating major compaction (all files) 2023-02-13 10:11:07,184 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:07,185 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:07,185 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of ff0cffc0193483c3f08a2f445595849a/family1 in testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:07,185 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp, totalSize=27.1 K 2023-02-13 10:11:07,187 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b0d079ff5f014238aec147439e1b0629, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057982 2023-02-13 10:11:07,188 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b66a4db9995b40169fe9e2c7b8b60284, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059975 2023-02-13 10:11:07,190 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 262f4823d48246059c2292b51be8050c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061954 2023-02-13 10:11:07,191 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 3f14befc07e74a6a8a7ecabfb993e952, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063949 2023-02-13 10:11:07,192 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 680e4ec90c714d2d8252a10b7a22b6ea, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:07,201 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): ff0cffc0193483c3f08a2f445595849a#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:07,645 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del 2023-02-13 10:11:07,646 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del 2023-02-13 10:11:08,498 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26315876bb384468bb59d779b89b6c6a 2023-02-13 10:11:08,499 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family1/26315876bb384468bb59d779b89b6c6a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/26315876bb384468bb59d779b89b6c6a 2023-02-13 10:11:08,516 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26315876bb384468bb59d779b89b6c6a 2023-02-13 10:11:08,517 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff0cffc0193483c3f08a2f445595849a/family1 of ff0cffc0193483c3f08a2f445595849a into 26315876bb384468bb59d779b89b6c6a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:11:08,517 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:08,517 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:08,517 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): ff0cffc0193483c3f08a2f445595849a/family2 is initiating major compaction (all files) 2023-02-13 10:11:08,517 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:08,517 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:08,517 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of ff0cffc0193483c3f08a2f445595849a/family2 in testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:08,517 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp, totalSize=25.4 K 2023-02-13 10:11:08,518 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 395b0a9262664115abc6eb9b00d48679, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057982 2023-02-13 10:11:08,518 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 306531b2615e46798ef153b161301529, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059975 2023-02-13 10:11:08,518 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting ff8d1c35beee415baccb62494ca1396d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061954 2023-02-13 10:11:08,519 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0eb46f39d945410d9e00fcb4b65e9014, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063949 2023-02-13 10:11:08,519 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 0fc2c03136ad431c8b5bd3f849ea94bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:08,524 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): ff0cffc0193483c3f08a2f445595849a#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:08,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea] to archive 2023-02-13 10:11:08,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:08,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b0d079ff5f014238aec147439e1b0629 2023-02-13 10:11:08,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/b66a4db9995b40169fe9e2c7b8b60284 2023-02-13 10:11:08,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/262f4823d48246059c2292b51be8050c 2023-02-13 10:11:08,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/3f14befc07e74a6a8a7ecabfb993e952 2023-02-13 10:11:08,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/680e4ec90c714d2d8252a10b7a22b6ea 2023-02-13 10:11:08,958 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213a4f006eff9cf49b7aa4ca300124d50c5_del 2023-02-13 10:11:08,959 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a4f006eff9cf49b7aa4ca300124d50c5_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213a4f006eff9cf49b7aa4ca300124d50c5_del 2023-02-13 10:11:09,791 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81f5e8ac69574f238dd51f6412deff2b 2023-02-13 10:11:09,792 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/.tmp/family2/81f5e8ac69574f238dd51f6412deff2b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/81f5e8ac69574f238dd51f6412deff2b 2023-02-13 10:11:09,798 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81f5e8ac69574f238dd51f6412deff2b 2023-02-13 10:11:09,799 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff0cffc0193483c3f08a2f445595849a/family2 of ff0cffc0193483c3f08a2f445595849a into 81f5e8ac69574f238dd51f6412deff2b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:11:09,799 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:09,799 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:09,799 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): b9edb4a3c4d71f1ff09d06871e99ec1b/family1 is initiating major compaction (all files) 2023-02-13 10:11:09,800 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:09,800 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:09,800 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of b9edb4a3c4d71f1ff09d06871e99ec1b/family1 in testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:09,800 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp, totalSize=27.1 K 2023-02-13 10:11:09,801 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 8390d70f7f5e46c5bc6945dc7f622365, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057983 2023-02-13 10:11:09,801 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 585b9040164d40efba0bd575e7f1e39e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059976 2023-02-13 10:11:09,802 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 8b75a423faf84aae82b26ad3c14f8b1d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061955 2023-02-13 10:11:09,802 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting dcd10e81bd38497e962cf27142bf6d51, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063950 2023-02-13 10:11:09,802 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting a39cf8c40b024a63a1bac0c2383bcb3d, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:09,811 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): b9edb4a3c4d71f1ff09d06871e99ec1b#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:09,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd] to archive 2023-02-13 10:11:09,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:09,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/395b0a9262664115abc6eb9b00d48679 2023-02-13 10:11:09,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/306531b2615e46798ef153b161301529 2023-02-13 10:11:09,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/ff8d1c35beee415baccb62494ca1396d 2023-02-13 10:11:09,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0eb46f39d945410d9e00fcb4b65e9014 2023-02-13 10:11:09,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family2/0fc2c03136ad431c8b5bd3f849ea94bd 2023-02-13 10:11:10,257 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del 2023-02-13 10:11:10,257 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del 2023-02-13 10:11:11,120 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5b69e18118347b6a4b25dc4cd540fa9 2023-02-13 10:11:11,120 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family1/b5b69e18118347b6a4b25dc4cd540fa9 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/b5b69e18118347b6a4b25dc4cd540fa9 2023-02-13 10:11:11,147 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5b69e18118347b6a4b25dc4cd540fa9 2023-02-13 10:11:11,147 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9edb4a3c4d71f1ff09d06871e99ec1b/family1 of b9edb4a3c4d71f1ff09d06871e99ec1b into b5b69e18118347b6a4b25dc4cd540fa9(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:11:11,148 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:11,148 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:11,148 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): b9edb4a3c4d71f1ff09d06871e99ec1b/family2 is initiating major compaction (all files) 2023-02-13 10:11:11,148 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:11,148 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:11,149 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of b9edb4a3c4d71f1ff09d06871e99ec1b/family2 in testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:11,149 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp, totalSize=25.4 K 2023-02-13 10:11:11,150 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 8957ea79a7fd4486b9cebff3844c1dd9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057983 2023-02-13 10:11:11,150 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting dacbdd9c1e43410f9cdf2c246ad299a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059976 2023-02-13 10:11:11,150 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 467fa73589a943efaef2ba939c0a88d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061955 2023-02-13 10:11:11,151 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 6ba015ab033e4b03abd8e2a093296075, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063950 2023-02-13 10:11:11,151 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b8832d17444b48fc8326116edc982eb0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:11,158 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): b9edb4a3c4d71f1ff09d06871e99ec1b#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:11,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d] to archive 2023-02-13 10:11:11,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:11,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8390d70f7f5e46c5bc6945dc7f622365 2023-02-13 10:11:11,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/585b9040164d40efba0bd575e7f1e39e 2023-02-13 10:11:11,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/8b75a423faf84aae82b26ad3c14f8b1d 2023-02-13 10:11:11,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/dcd10e81bd38497e962cf27142bf6d51 2023-02-13 10:11:11,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/a39cf8c40b024a63a1bac0c2383bcb3d 2023-02-13 10:11:11,572 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021365f9f285e5404a3dbd1527e9c3cc04e6_del 2023-02-13 10:11:11,573 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021365f9f285e5404a3dbd1527e9c3cc04e6_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021365f9f285e5404a3dbd1527e9c3cc04e6_del 2023-02-13 10:11:11,998 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63c3e6897d00486fb2bbc7c2f9614e04 2023-02-13 10:11:12,000 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/.tmp/family2/63c3e6897d00486fb2bbc7c2f9614e04 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/63c3e6897d00486fb2bbc7c2f9614e04 2023-02-13 10:11:12,006 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63c3e6897d00486fb2bbc7c2f9614e04 2023-02-13 10:11:12,006 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9edb4a3c4d71f1ff09d06871e99ec1b/family2 of b9edb4a3c4d71f1ff09d06871e99ec1b into 63c3e6897d00486fb2bbc7c2f9614e04(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 10:11:12,007 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:12,007 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:12,007 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 3a5cd0a3e9fc007920bb491a68f2767b/family1 is initiating major compaction (all files) 2023-02-13 10:11:12,007 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:12,007 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:12,007 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 3a5cd0a3e9fc007920bb491a68f2767b/family1 in testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:12,007 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp, totalSize=27.1 K 2023-02-13 10:11:12,008 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 1400fd3bbc3b4f08b47f1f68c109d7ec, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057983 2023-02-13 10:11:12,008 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 2d711cc914dc4f279a989b44f5301caa, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059976 2023-02-13 10:11:12,009 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 75c68d7741ef46b1a4c6f53923b34da7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061954 2023-02-13 10:11:12,009 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting b31c955420ad4117b617d2f4972f1b6c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063949 2023-02-13 10:11:12,010 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting d53e952ba42b4690b9488d8e9f50a57a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:12,019 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 3a5cd0a3e9fc007920bb491a68f2767b#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:12,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0] to archive 2023-02-13 10:11:12,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:12,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/8957ea79a7fd4486b9cebff3844c1dd9 2023-02-13 10:11:12,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/dacbdd9c1e43410f9cdf2c246ad299a1 2023-02-13 10:11:12,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/467fa73589a943efaef2ba939c0a88d7 2023-02-13 10:11:12,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/6ba015ab033e4b03abd8e2a093296075 2023-02-13 10:11:12,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family2/b8832d17444b48fc8326116edc982eb0 2023-02-13 10:11:12,463 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del 2023-02-13 10:11:12,463 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del 2023-02-13 10:11:13,323 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf56e37749bd49af8e7b4fdc3f972271 2023-02-13 10:11:13,324 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family1/cf56e37749bd49af8e7b4fdc3f972271 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/cf56e37749bd49af8e7b4fdc3f972271 2023-02-13 10:11:13,341 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf56e37749bd49af8e7b4fdc3f972271 2023-02-13 10:11:13,342 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3a5cd0a3e9fc007920bb491a68f2767b/family1 of 3a5cd0a3e9fc007920bb491a68f2767b into cf56e37749bd49af8e7b4fdc3f972271(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:11:13,342 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:13,342 DEBUG [Listener at localhost.localdomain/39579] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 10:11:13,343 DEBUG [Listener at localhost.localdomain/39579] regionserver.HStore(1912): 3a5cd0a3e9fc007920bb491a68f2767b/family2 is initiating major compaction (all files) 2023-02-13 10:11:13,343 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 10:11:13,343 INFO [Listener at localhost.localdomain/39579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 10:11:13,343 INFO [Listener at localhost.localdomain/39579] regionserver.HRegion(2258): Starting compaction of 3a5cd0a3e9fc007920bb491a68f2767b/family2 in testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:13,343 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c] into tmpdir=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp, totalSize=25.4 K 2023-02-13 10:11:13,343 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 14602baadfe0445c95ddfc92b0aa6518, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676283057983 2023-02-13 10:11:13,343 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 00e17ac29362456b8b96e292060d8f0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676283059976 2023-02-13 10:11:13,344 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 5837443ca2a649da833e14a462cf4e11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676283061954 2023-02-13 10:11:13,344 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 89c9453ab2414cb78a735a24c9979f55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676283063949 2023-02-13 10:11:13,344 DEBUG [Listener at localhost.localdomain/39579] compactions.Compactor(207): Compacting 493c144cf00042ed9aa6577f9ddaf32c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 10:11:13,351 INFO [Listener at localhost.localdomain/39579] throttle.PressureAwareThroughputController(145): 3a5cd0a3e9fc007920bb491a68f2767b#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 10:11:13,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a] to archive 2023-02-13 10:11:13,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:13,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/1400fd3bbc3b4f08b47f1f68c109d7ec 2023-02-13 10:11:13,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/2d711cc914dc4f279a989b44f5301caa 2023-02-13 10:11:13,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/75c68d7741ef46b1a4c6f53923b34da7 2023-02-13 10:11:13,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/b31c955420ad4117b617d2f4972f1b6c 2023-02-13 10:11:13,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/d53e952ba42b4690b9488d8e9f50a57a 2023-02-13 10:11:13,766 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021362fa689bf21f41d9a00f0e35d6d4dd68_del 2023-02-13 10:11:13,766 INFO [Listener at localhost.localdomain/39579] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021362fa689bf21f41d9a00f0e35d6d4dd68_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021362fa689bf21f41d9a00f0e35d6d4dd68_del 2023-02-13 10:11:14,600 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 375aaf7926b7425fb0e54535c438b4c7 2023-02-13 10:11:14,601 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/.tmp/family2/375aaf7926b7425fb0e54535c438b4c7 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/375aaf7926b7425fb0e54535c438b4c7 2023-02-13 10:11:14,605 INFO [Listener at localhost.localdomain/39579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 375aaf7926b7425fb0e54535c438b4c7 2023-02-13 10:11:14,605 INFO [Listener at localhost.localdomain/39579] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3a5cd0a3e9fc007920bb491a68f2767b/family2 of 3a5cd0a3e9fc007920bb491a68f2767b into 375aaf7926b7425fb0e54535c438b4c7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 10:11:14,606 DEBUG [Listener at localhost.localdomain/39579] regionserver.HRegion(2288): Compaction status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:14,609 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:14,612 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:14,618 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:14,619 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:14,625 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42277] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6\xCE U]\xDE\xD4p\x0F_\xE1\x07\x1A\xB5\xC1{"\x10\xC5\xF6\x12\xCB\xAA\xA6\x1E\xD5(\xE7\xAB\xB2,\xA2i2*\x10\xD6\xFD\xF2[\xC0G\xC1\x8D\x98514>\x9Bo\x032\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-13 10:11:14,647 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 10:11:14,647 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 10:11:14,648 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676283674648 2023-02-13 10:11:14,648 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:11:14,648 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 10:11:14,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c] to archive 2023-02-13 10:11:14,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:14,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/14602baadfe0445c95ddfc92b0aa6518 2023-02-13 10:11:14,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/00e17ac29362456b8b96e292060d8f0e 2023-02-13 10:11:14,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/5837443ca2a649da833e14a462cf4e11 2023-02-13 10:11:14,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/89c9453ab2414cb78a735a24c9979f55 2023-02-13 10:11:14,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family2/493c144cf00042ed9aa6577f9ddaf32c 2023-02-13 10:11:14,903 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-13 10:11:14,922 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del 2023-02-13 10:11:14,939 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del 2023-02-13 10:11:14,957 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del 2023-02-13 10:11:14,957 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:14,957 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] zookeeper.ReadOnlyZKClient(139): Connect 0x2f075622 to 127.0.0.1:57475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 10:11:15,006 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14007e62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 10:11:15,007 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:15,957 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c70b50439f774384b91f01febaba6e10 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213c70b50439f774384b91f01febaba6e10 2023-02-13 10:11:15,957 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:15,966 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 10:11:15,968 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:44974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 10:11:15,975 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 10:11:15,976 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:43238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 10:11:16,004 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3974f200603d434298b1f5ec012c7d6b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 10:11:16,005 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3974f200603d434298b1f5ec012c7d6b}] 2023-02-13 10:11:16,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3974f200603d434298b1f5ec012c7d6b for inclusion in 3a5cd0a3e9fc007920bb491a68f2767b/family1 2023-02-13 10:11:16,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 10:11:16,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 10:11:16,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for 3a5cd0a3e9fc007920bb491a68f2767b: 2023-02-13 10:11:16,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3974f200603d434298b1f5ec012c7d6b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__qionl5kcmhheq5st35953nekfshgl80cldoqqp2iubaluvrbvqsgb2g9m4mhk5nc/family1/3974f200603d434298b1f5ec012c7d6b 2023-02-13 10:11:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__qionl5kcmhheq5st35953nekfshgl80cldoqqp2iubaluvrbvqsgb2g9m4mhk5nc/family1/3974f200603d434298b1f5ec012c7d6b as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/de40d3c4e05243acbc86d8cfad4af222_SeqId_28_ 2023-02-13 10:11:16,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__qionl5kcmhheq5st35953nekfshgl80cldoqqp2iubaluvrbvqsgb2g9m4mhk5nc/family1/3974f200603d434298b1f5ec012c7d6b into 3a5cd0a3e9fc007920bb491a68f2767b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/de40d3c4e05243acbc86d8cfad4af222_SeqId_28_ - updating store file list. 2023-02-13 10:11:16,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/de40d3c4e05243acbc86d8cfad4af222_SeqId_28_ into 3a5cd0a3e9fc007920bb491a68f2767b/family1 2023-02-13 10:11:16,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__qionl5kcmhheq5st35953nekfshgl80cldoqqp2iubaluvrbvqsgb2g9m4mhk5nc/family1/3974f200603d434298b1f5ec012c7d6b into 3a5cd0a3e9fc007920bb491a68f2767b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/family1/de40d3c4e05243acbc86d8cfad4af222_SeqId_28_) 2023-02-13 10:11:16,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__qionl5kcmhheq5st35953nekfshgl80cldoqqp2iubaluvrbvqsgb2g9m4mhk5nc/family1/3974f200603d434298b1f5ec012c7d6b 2023-02-13 10:11:16,047 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:16,048 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:16,049 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302131cf3ceeca7984603a08fed8c35f588af to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302131cf3ceeca7984603a08fed8c35f588af 2023-02-13 10:11:16,050 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213510e6a352b2d432b9b0955e8702fb28d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213510e6a352b2d432b9b0955e8702fb28d 2023-02-13 10:11:16,050 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361504d242d144b498f16885d2e724e70 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361504d242d144b498f16885d2e724e70 2023-02-13 10:11:16,051 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213972e510eb33449ccafebb38948f5dbc2 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213972e510eb33449ccafebb38948f5dbc2 2023-02-13 10:11:16,051 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 10:11:16,051 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 10:11:16,051 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:16,051 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:16,996 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a376ec3f973b454f914f2357c81c09bd to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213a376ec3f973b454f914f2357c81c09bd 2023-02-13 10:11:16,997 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:17,034 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9eb3bdeca741410e895ae424b3bc6676 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 10:11:17,035 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9eb3bdeca741410e895ae424b3bc6676}] 2023-02-13 10:11:17,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9eb3bdeca741410e895ae424b3bc6676 for inclusion in b9edb4a3c4d71f1ff09d06871e99ec1b/family1 2023-02-13 10:11:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 10:11:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 10:11:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for b9edb4a3c4d71f1ff09d06871e99ec1b: 2023-02-13 10:11:17,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9eb3bdeca741410e895ae424b3bc6676 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__pornkuvb3r5rc1f43g6s65gbkvrv7ergfbfjthsffmtpt20shu9nj9hfej9mckgb/family1/9eb3bdeca741410e895ae424b3bc6676 2023-02-13 10:11:17,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__pornkuvb3r5rc1f43g6s65gbkvrv7ergfbfjthsffmtpt20shu9nj9hfej9mckgb/family1/9eb3bdeca741410e895ae424b3bc6676 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/6f8676630e5d455c8e59a283a901a8d6_SeqId_28_ 2023-02-13 10:11:17,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__pornkuvb3r5rc1f43g6s65gbkvrv7ergfbfjthsffmtpt20shu9nj9hfej9mckgb/family1/9eb3bdeca741410e895ae424b3bc6676 into b9edb4a3c4d71f1ff09d06871e99ec1b/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/6f8676630e5d455c8e59a283a901a8d6_SeqId_28_ - updating store file list. 2023-02-13 10:11:17,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/6f8676630e5d455c8e59a283a901a8d6_SeqId_28_ into b9edb4a3c4d71f1ff09d06871e99ec1b/family1 2023-02-13 10:11:17,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__pornkuvb3r5rc1f43g6s65gbkvrv7ergfbfjthsffmtpt20shu9nj9hfej9mckgb/family1/9eb3bdeca741410e895ae424b3bc6676 into b9edb4a3c4d71f1ff09d06871e99ec1b/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/family1/6f8676630e5d455c8e59a283a901a8d6_SeqId_28_) 2023-02-13 10:11:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__pornkuvb3r5rc1f43g6s65gbkvrv7ergfbfjthsffmtpt20shu9nj9hfej9mckgb/family1/9eb3bdeca741410e895ae424b3bc6676 2023-02-13 10:11:17,079 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:17,080 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:17,081 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134abc24aa4d724a5d88a07d2ea6500290 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134abc24aa4d724a5d88a07d2ea6500290 2023-02-13 10:11:17,082 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213993ade37631547ac921456ee3790628e to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213993ade37631547ac921456ee3790628e 2023-02-13 10:11:17,083 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139bb566dce3f44518b9b23b4494473ff0 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139bb566dce3f44518b9b23b4494473ff0 2023-02-13 10:11:17,084 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213c21454f4e289497dbe984a395c2ceed7 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213c21454f4e289497dbe984a395c2ceed7 2023-02-13 10:11:17,084 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 10:11:17,084 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 10:11:17,084 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:17,084 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:18,022 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021346ffbad6ea5b4f5699bb255efb4a3db8 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021346ffbad6ea5b4f5699bb255efb4a3db8 2023-02-13 10:11:18,023 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:18,061 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ef3466e3f0344f0792e75cdf5cb6bb43 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 10:11:18,061 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a., hostname=jenkins-hbase16.apache.org,38311,1676282881622, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ef3466e3f0344f0792e75cdf5cb6bb43}] 2023-02-13 10:11:18,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ef3466e3f0344f0792e75cdf5cb6bb43 for inclusion in ff0cffc0193483c3f08a2f445595849a/family1 2023-02-13 10:11:18,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 10:11:18,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 10:11:18,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegion(2445): Flush status journal for ff0cffc0193483c3f08a2f445595849a: 2023-02-13 10:11:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ef3466e3f0344f0792e75cdf5cb6bb43 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__5g2l2imvc92nr10s85vlrpuv5a0t9gpud53lht01j35at7khac3q4h6b4qbulg5i/family1/ef3466e3f0344f0792e75cdf5cb6bb43 2023-02-13 10:11:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__5g2l2imvc92nr10s85vlrpuv5a0t9gpud53lht01j35at7khac3q4h6b4qbulg5i/family1/ef3466e3f0344f0792e75cdf5cb6bb43 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/c8d201154f1240299ac7546e0bee23c7_SeqId_28_ 2023-02-13 10:11:18,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__5g2l2imvc92nr10s85vlrpuv5a0t9gpud53lht01j35at7khac3q4h6b4qbulg5i/family1/ef3466e3f0344f0792e75cdf5cb6bb43 into ff0cffc0193483c3f08a2f445595849a/family1 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/c8d201154f1240299ac7546e0bee23c7_SeqId_28_ - updating store file list. 2023-02-13 10:11:18,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/c8d201154f1240299ac7546e0bee23c7_SeqId_28_ into ff0cffc0193483c3f08a2f445595849a/family1 2023-02-13 10:11:18,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__5g2l2imvc92nr10s85vlrpuv5a0t9gpud53lht01j35at7khac3q4h6b4qbulg5i/family1/ef3466e3f0344f0792e75cdf5cb6bb43 into ff0cffc0193483c3f08a2f445595849a/family1 (new location: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/family1/c8d201154f1240299ac7546e0bee23c7_SeqId_28_) 2023-02-13 10:11:18,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38311] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/staging/jenkins__testMajorCompactionFromAdmin__5g2l2imvc92nr10s85vlrpuv5a0t9gpud53lht01j35at7khac3q4h6b4qbulg5i/family1/ef3466e3f0344f0792e75cdf5cb6bb43 2023-02-13 10:11:18,105 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:18,105 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:18,107 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134aed38b03bb04e0081f9e1c1d9802d48 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134aed38b03bb04e0081f9e1c1d9802d48 2023-02-13 10:11:18,107 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213700b7ad4650743ecaa2c78f7a1794e2d to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213700b7ad4650743ecaa2c78f7a1794e2d 2023-02-13 10:11:18,108 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213d9c8ee93f3444390a90af05266f15752 to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213d9c8ee93f3444390a90af05266f15752 2023-02-13 10:11:18,109 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213fd9a03fc2a894cf585fc7e54f3d2f96b to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213fd9a03fc2a894cf585fc7e54f3d2f96b 2023-02-13 10:11:18,109 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 10:11:18,109 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 10:11:18,110 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:18,110 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 10:11:18,110 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 10:11:18,110 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del] 2023-02-13 10:11:18,110 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:18,111 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213b966e22586574e1fbbc20bcd4a27675b_del 2023-02-13 10:11:18,111 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 10:11:18,111 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del] 2023-02-13 10:11:18,111 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:18,112 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213a6f0cf2b47c749c0806ef7bbec86f3e1_del 2023-02-13 10:11:18,112 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 10:11:18,112 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del] 2023-02-13 10:11:18,112 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 10:11:18,113 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del to hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213e7b48b7fea1e4d79a5bfc106e779e219_del 2023-02-13 10:11:18,113 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 10:11:18,113 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676282886049] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 10:11:18,114 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 10:11:18,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.4680 sec 2023-02-13 10:11:18,134 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:18,137 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:18,140 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 10:11:18,141 DEBUG [Listener at localhost.localdomain/39579] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 10:11:18,146 INFO [Listener at localhost.localdomain/39579] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 10:11:18,174 INFO [Listener at localhost.localdomain/39579] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=245 (was 252), OpenFileDescriptor=627 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=81 (was 82), ProcessCount=165 (was 165), AvailableMemoryMB=7629 (was 7657) 2023-02-13 10:11:18,175 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37d84738 to 127.0.0.1:57475 2023-02-13 10:11:18,175 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:18,175 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 10:11:18,175 INFO [Listener at localhost.localdomain/39579] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 10:11:18,175 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bf9b76d to 127.0.0.1:57475 2023-02-13 10:11:18,175 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:18,176 DEBUG [Listener at localhost.localdomain/39579] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 10:11:18,176 DEBUG [Listener at localhost.localdomain/39579] util.JVMClusterUtil(257): Found active master hash=1939827665, stopped=false 2023-02-13 10:11:18,176 INFO [Listener at localhost.localdomain/39579] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:11:18,196 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 10:11:18,196 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 10:11:18,196 INFO [Listener at localhost.localdomain/39579] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 10:11:18,196 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:11:18,196 DEBUG [Listener at localhost.localdomain/39579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e09e819 to 127.0.0.1:57475 2023-02-13 10:11:18,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 10:11:18,196 DEBUG [Listener at localhost.localdomain/39579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:18,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 10:11:18,197 INFO [Listener at localhost.localdomain/39579] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase16.apache.org,38311,1676282881622' ***** 2023-02-13 10:11:18,197 INFO [Listener at localhost.localdomain/39579] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 10:11:18,197 INFO [RS:0;jenkins-hbase16:38311] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 10:11:18,197 INFO [RS:0;jenkins-hbase16:38311] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 10:11:18,197 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 10:11:18,197 INFO [RS:0;jenkins-hbase16:38311] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 10:11:18,198 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 30df5af140d7623958af3d33dc87c931 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 5f41dd240b983d854e23cd954e027448 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 045f8a90e57c08d60c807c425d886d84 2023-02-13 10:11:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 30df5af140d7623958af3d33dc87c931, disabling compactions & flushes 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 46e20509df636f8c5fceac1b22b8703f 2023-02-13 10:11:18,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for bd73e34f431932d74e40a406e256a3a8 2023-02-13 10:11:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for feb7074ad7e4dc5391d9000c2a69a333 2023-02-13 10:11:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. after waiting 0 ms 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for c6552cd4e72d5ca6219b168bcf32684a 2023-02-13 10:11:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 28631355208dcbda9e47f3d8787b6622 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for f92606d2b350e4ac8e2f20872f822e8b 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for f23999f2ff6bec9ffff86cfc8321429b 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 74ee92c3cf25e92ef9b18a057ecd963f 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 99dbf187396b633bba7f84c449d532d4 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for c7bad36d3e3feba9df3f34650d0420ca 2023-02-13 10:11:18,199 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for ec71b4d134f40901c4ce961630ab2813 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for fb0bfb57d3c4dd764ac4f766a0595ed0 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for b9edb4a3c4d71f1ff09d06871e99ec1b 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for f822e7441393470eb937d55672c0347b 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 1cad52cf8b278bc4b5803d83efcec02c 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 3a5cd0a3e9fc007920bb491a68f2767b 2023-02-13 10:11:18,200 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1145): stopping server jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:18,200 DEBUG [RS:0;jenkins-hbase16:38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a8c0357 to 127.0.0.1:57475 2023-02-13 10:11:18,200 DEBUG [RS:0;jenkins-hbase16:38311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:18,201 INFO [RS:0;jenkins-hbase16:38311] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 10:11:18,201 INFO [RS:0;jenkins-hbase16:38311] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 10:11:18,201 INFO [RS:0;jenkins-hbase16:38311] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 10:11:18,201 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 10:11:18,201 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-13 10:11:18,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 10:11:18,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 10:11:18,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 10:11:18,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 10:11:18,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 10:11:18,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-13 10:11:18,202 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 045f8a90e57c08d60c807c425d886d84, 1588230740, 1cad52cf8b278bc4b5803d83efcec02c, 28631355208dcbda9e47f3d8787b6622, 30df5af140d7623958af3d33dc87c931, 3a5cd0a3e9fc007920bb491a68f2767b, 46e20509df636f8c5fceac1b22b8703f, 5f41dd240b983d854e23cd954e027448, 74ee92c3cf25e92ef9b18a057ecd963f, 99dbf187396b633bba7f84c449d532d4, b9edb4a3c4d71f1ff09d06871e99ec1b, bd73e34f431932d74e40a406e256a3a8, c6552cd4e72d5ca6219b168bcf32684a, c7bad36d3e3feba9df3f34650d0420ca, ec71b4d134f40901c4ce961630ab2813, f23999f2ff6bec9ffff86cfc8321429b, f822e7441393470eb937d55672c0347b, f92606d2b350e4ac8e2f20872f822e8b, fb0bfb57d3c4dd764ac4f766a0595ed0, feb7074ad7e4dc5391d9000c2a69a333, ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:11:18,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/30df5af140d7623958af3d33dc87c931/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 10:11:18,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 30df5af140d7623958af3d33dc87c931: Waiting for close lock at 1676283078199Running coprocessor pre-close hooks at 1676283078199Disabling compacts and flushes for region at 1676283078199Disabling writes for close at 1676283078199Writing region close event to WAL at 1676283078199Running coprocessor post-close hooks at 1676283078204 (+5 ms)Closed at 1676283078205 (+1 ms) 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676282930769.30df5af140d7623958af3d33dc87c931. 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 5f41dd240b983d854e23cd954e027448, disabling compactions & flushes 2023-02-13 10:11:18,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. after waiting 0 ms 2023-02-13 10:11:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:11:18,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/5f41dd240b983d854e23cd954e027448/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 10:11:18,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:11:18,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 5f41dd240b983d854e23cd954e027448: Waiting for close lock at 1676283078205Running coprocessor pre-close hooks at 1676283078205Disabling compacts and flushes for region at 1676283078205Disabling writes for close at 1676283078205Writing region close event to WAL at 1676283078206 (+1 ms)Running coprocessor post-close hooks at 1676283078209 (+3 ms)Closed at 1676283078210 (+1 ms) 2023-02-13 10:11:18,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676282930769.5f41dd240b983d854e23cd954e027448. 2023-02-13 10:11:18,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 045f8a90e57c08d60c807c425d886d84, disabling compactions & flushes 2023-02-13 10:11:18,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:11:18,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:11:18,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. after waiting 0 ms 2023-02-13 10:11:18,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:11:18,212 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 10:11:18,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/045f8a90e57c08d60c807c425d886d84/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 10:11:18,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:11:18,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 045f8a90e57c08d60c807c425d886d84: Waiting for close lock at 1676283078210Running coprocessor pre-close hooks at 1676283078210Disabling compacts and flushes for region at 1676283078210Disabling writes for close at 1676283078211 (+1 ms)Writing region close event to WAL at 1676283078212 (+1 ms)Running coprocessor post-close hooks at 1676283078215 (+3 ms)Closed at 1676283078215 2023-02-13 10:11:18,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676282991598.045f8a90e57c08d60c807c425d886d84. 2023-02-13 10:11:18,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 46e20509df636f8c5fceac1b22b8703f, disabling compactions & flushes 2023-02-13 10:11:18,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:11:18,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:11:18,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. after waiting 0 ms 2023-02-13 10:11:18,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:11:18,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/46e20509df636f8c5fceac1b22b8703f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 46e20509df636f8c5fceac1b22b8703f: Waiting for close lock at 1676283078216Running coprocessor pre-close hooks at 1676283078216Disabling compacts and flushes for region at 1676283078216Disabling writes for close at 1676283078216Writing region close event to WAL at 1676283078216Running coprocessor post-close hooks at 1676283078219 (+3 ms)Closed at 1676283078219 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676283023253.46e20509df636f8c5fceac1b22b8703f. 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing bd73e34f431932d74e40a406e256a3a8, disabling compactions & flushes 2023-02-13 10:11:18,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. after waiting 0 ms 2023-02-13 10:11:18,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:11:18,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2744): Flushing bd73e34f431932d74e40a406e256a3a8 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-13 10:11:18,284 INFO [regionserver/jenkins-hbase16:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-13 10:11:18,402 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740, 1cad52cf8b278bc4b5803d83efcec02c, 28631355208dcbda9e47f3d8787b6622, 3a5cd0a3e9fc007920bb491a68f2767b, 74ee92c3cf25e92ef9b18a057ecd963f, 99dbf187396b633bba7f84c449d532d4, b9edb4a3c4d71f1ff09d06871e99ec1b, bd73e34f431932d74e40a406e256a3a8, c6552cd4e72d5ca6219b168bcf32684a, c7bad36d3e3feba9df3f34650d0420ca, ec71b4d134f40901c4ce961630ab2813, f23999f2ff6bec9ffff86cfc8321429b, f822e7441393470eb937d55672c0347b, f92606d2b350e4ac8e2f20872f822e8b, fb0bfb57d3c4dd764ac4f766a0595ed0, feb7074ad7e4dc5391d9000c2a69a333, ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:11:18,603 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740, 1cad52cf8b278bc4b5803d83efcec02c, 28631355208dcbda9e47f3d8787b6622, 3a5cd0a3e9fc007920bb491a68f2767b, 74ee92c3cf25e92ef9b18a057ecd963f, 99dbf187396b633bba7f84c449d532d4, b9edb4a3c4d71f1ff09d06871e99ec1b, bd73e34f431932d74e40a406e256a3a8, c6552cd4e72d5ca6219b168bcf32684a, c7bad36d3e3feba9df3f34650d0420ca, ec71b4d134f40901c4ce961630ab2813, f23999f2ff6bec9ffff86cfc8321429b, f822e7441393470eb937d55672c0347b, f92606d2b350e4ac8e2f20872f822e8b, fb0bfb57d3c4dd764ac4f766a0595ed0, feb7074ad7e4dc5391d9000c2a69a333, ff0cffc0193483c3f08a2f445595849a 2023-02-13 10:11:18,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/info/ca6336d24bca48398c16ab2443da6b1e 2023-02-13 10:11:18,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca6336d24bca48398c16ab2443da6b1e 2023-02-13 10:11:18,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/.tmp/info/342f77b4e4b945429061fc2cd0b23270 2023-02-13 10:11:18,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/.tmp/info/342f77b4e4b945429061fc2cd0b23270 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/info/342f77b4e4b945429061fc2cd0b23270 2023-02-13 10:11:18,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/info/342f77b4e4b945429061fc2cd0b23270, entries=3, sequenceid=7, filesize=4.8 K 2023-02-13 10:11:18,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for bd73e34f431932d74e40a406e256a3a8 in 414ms, sequenceid=7, compaction requested=false 2023-02-13 10:11:18,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/namespace/bd73e34f431932d74e40a406e256a3a8/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-13 10:11:18,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:11:18,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for bd73e34f431932d74e40a406e256a3a8: Waiting for close lock at 1676283078219Running coprocessor pre-close hooks at 1676283078219Disabling compacts and flushes for region at 1676283078219Disabling writes for close at 1676283078219Obtaining lock to block concurrent updates at 1676283078219Preparing flush snapshotting stores in bd73e34f431932d74e40a406e256a3a8 at 1676283078219Finished memstore snapshotting hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676283078220 (+1 ms)Flushing stores of hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. at 1676283078220Flushing bd73e34f431932d74e40a406e256a3a8/info: creating writer at 1676283078220Flushing bd73e34f431932d74e40a406e256a3a8/info: appending metadata at 1676283078222 (+2 ms)Flushing bd73e34f431932d74e40a406e256a3a8/info: closing flushed file at 1676283078222Flushing bd73e34f431932d74e40a406e256a3a8/info: reopening flushed file at 1676283078630 (+408 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for bd73e34f431932d74e40a406e256a3a8 in 414ms, sequenceid=7, compaction requested=false at 1676283078633 (+3 ms)Writing region close event to WAL at 1676283078634 (+1 ms)Running coprocessor post-close hooks at 1676283078637 (+3 ms)Closed at 1676283078637 2023-02-13 10:11:18,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676282885132.bd73e34f431932d74e40a406e256a3a8. 2023-02-13 10:11:18,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing feb7074ad7e4dc5391d9000c2a69a333, disabling compactions & flushes 2023-02-13 10:11:18,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:11:18,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:11:18,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. after waiting 0 ms 2023-02-13 10:11:18,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:11:18,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/feb7074ad7e4dc5391d9000c2a69a333/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 10:11:18,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for feb7074ad7e4dc5391d9000c2a69a333: Waiting for close lock at 1676283078638Running coprocessor pre-close hooks at 1676283078638Disabling compacts and flushes for region at 1676283078638Disabling writes for close at 1676283078638Writing region close event to WAL at 1676283078638Running coprocessor post-close hooks at 1676283078641 (+3 ms)Closed at 1676283078641 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676282949354.feb7074ad7e4dc5391d9000c2a69a333. 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing c6552cd4e72d5ca6219b168bcf32684a, disabling compactions & flushes 2023-02-13 10:11:18,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. after waiting 0 ms 2023-02-13 10:11:18,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:11:18,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c6552cd4e72d5ca6219b168bcf32684a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 10:11:18,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for c6552cd4e72d5ca6219b168bcf32684a: Waiting for close lock at 1676283078641Running coprocessor pre-close hooks at 1676283078641Disabling compacts and flushes for region at 1676283078641Disabling writes for close at 1676283078641Writing region close event to WAL at 1676283078642 (+1 ms)Running coprocessor post-close hooks at 1676283078644 (+2 ms)Closed at 1676283078645 (+1 ms) 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676282967433.c6552cd4e72d5ca6219b168bcf32684a. 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 28631355208dcbda9e47f3d8787b6622, disabling compactions & flushes 2023-02-13 10:11:18,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. after waiting 0 ms 2023-02-13 10:11:18,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:11:18,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/28631355208dcbda9e47f3d8787b6622/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 10:11:18,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 28631355208dcbda9e47f3d8787b6622: Waiting for close lock at 1676283078645Running coprocessor pre-close hooks at 1676283078645Disabling compacts and flushes for region at 1676283078645Disabling writes for close at 1676283078645Writing region close event to WAL at 1676283078646 (+1 ms)Running coprocessor post-close hooks at 1676283078648 (+2 ms)Closed at 1676283078649 (+1 ms) 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676282991598.28631355208dcbda9e47f3d8787b6622. 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing f92606d2b350e4ac8e2f20872f822e8b, disabling compactions & flushes 2023-02-13 10:11:18,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. after waiting 0 ms 2023-02-13 10:11:18,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:11:18,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f92606d2b350e4ac8e2f20872f822e8b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-13 10:11:18,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:11:18,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for f92606d2b350e4ac8e2f20872f822e8b: Waiting for close lock at 1676283078649Running coprocessor pre-close hooks at 1676283078649Disabling compacts and flushes for region at 1676283078649Disabling writes for close at 1676283078649Writing region close event to WAL at 1676283078650 (+1 ms)Running coprocessor post-close hooks at 1676283078653 (+3 ms)Closed at 1676283078653 2023-02-13 10:11:18,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676282886233.f92606d2b350e4ac8e2f20872f822e8b. 2023-02-13 10:11:18,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing f23999f2ff6bec9ffff86cfc8321429b, disabling compactions & flushes 2023-02-13 10:11:18,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:11:18,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:11:18,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. after waiting 0 ms 2023-02-13 10:11:18,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:11:18,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/f23999f2ff6bec9ffff86cfc8321429b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:11:18,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for f23999f2ff6bec9ffff86cfc8321429b: Waiting for close lock at 1676283078654Running coprocessor pre-close hooks at 1676283078654Disabling compacts and flushes for region at 1676283078654Disabling writes for close at 1676283078654Writing region close event to WAL at 1676283078655 (+1 ms)Running coprocessor post-close hooks at 1676283078657 (+2 ms)Closed at 1676283078657 2023-02-13 10:11:18,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676283023253.f23999f2ff6bec9ffff86cfc8321429b. 2023-02-13 10:11:18,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing ff0cffc0193483c3f08a2f445595849a, disabling compactions & flushes 2023-02-13 10:11:18,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:18,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:18,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. after waiting 0 ms 2023-02-13 10:11:18,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:18,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/ff0cffc0193483c3f08a2f445595849a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:18,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for ff0cffc0193483c3f08a2f445595849a: Waiting for close lock at 1676283078658Running coprocessor pre-close hooks at 1676283078658Disabling compacts and flushes for region at 1676283078658Disabling writes for close at 1676283078658Writing region close event to WAL at 1676283078659 (+1 ms)Running coprocessor post-close hooks at 1676283078661 (+2 ms)Closed at 1676283078661 2023-02-13 10:11:18,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676283055838.ff0cffc0193483c3f08a2f445595849a. 2023-02-13 10:11:18,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 74ee92c3cf25e92ef9b18a057ecd963f, disabling compactions & flushes 2023-02-13 10:11:18,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:11:18,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:11:18,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. after waiting 0 ms 2023-02-13 10:11:18,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:11:18,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithMonthlyPolicy/74ee92c3cf25e92ef9b18a057ecd963f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 10:11:18,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:11:18,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 74ee92c3cf25e92ef9b18a057ecd963f: Waiting for close lock at 1676283078662Running coprocessor pre-close hooks at 1676283078662Disabling compacts and flushes for region at 1676283078662Disabling writes for close at 1676283078662Writing region close event to WAL at 1676283078662Running coprocessor post-close hooks at 1676283078666 (+4 ms)Closed at 1676283078666 2023-02-13 10:11:18,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676283041462.74ee92c3cf25e92ef9b18a057ecd963f. 2023-02-13 10:11:18,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 99dbf187396b633bba7f84c449d532d4, disabling compactions & flushes 2023-02-13 10:11:18,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:11:18,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:11:18,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. after waiting 0 ms 2023-02-13 10:11:18,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:11:18,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/ns/testMinorCompaction/99dbf187396b633bba7f84c449d532d4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 99dbf187396b633bba7f84c449d532d4: Waiting for close lock at 1676283078666Running coprocessor pre-close hooks at 1676283078666Disabling compacts and flushes for region at 1676283078666Disabling writes for close at 1676283078667 (+1 ms)Writing region close event to WAL at 1676283078668 (+1 ms)Running coprocessor post-close hooks at 1676283078671 (+3 ms)Closed at 1676283078673 (+2 ms) 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676283023253.99dbf187396b633bba7f84c449d532d4. 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing c7bad36d3e3feba9df3f34650d0420ca, disabling compactions & flushes 2023-02-13 10:11:18,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. after waiting 0 ms 2023-02-13 10:11:18,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:11:18,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMinorCompactionWithWeeklyPolicy/c7bad36d3e3feba9df3f34650d0420ca/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 10:11:18,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for c7bad36d3e3feba9df3f34650d0420ca: Waiting for close lock at 1676283078673Running coprocessor pre-close hooks at 1676283078673Disabling compacts and flushes for region at 1676283078673Disabling writes for close at 1676283078673Writing region close event to WAL at 1676283078674 (+1 ms)Running coprocessor post-close hooks at 1676283078678 (+4 ms)Closed at 1676283078678 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676282916692.c7bad36d3e3feba9df3f34650d0420ca. 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing ec71b4d134f40901c4ce961630ab2813, disabling compactions & flushes 2023-02-13 10:11:18,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. after waiting 0 ms 2023-02-13 10:11:18,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:11:18,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testScannerOnBulkLoadRefHFiles/ec71b4d134f40901c4ce961630ab2813/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 10:11:18,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for ec71b4d134f40901c4ce961630ab2813: Waiting for close lock at 1676283078678Running coprocessor pre-close hooks at 1676283078678Disabling compacts and flushes for region at 1676283078678Disabling writes for close at 1676283078678Writing region close event to WAL at 1676283078679 (+1 ms)Running coprocessor post-close hooks at 1676283078683 (+4 ms)Closed at 1676283078683 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676282930769.ec71b4d134f40901c4ce961630ab2813. 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing fb0bfb57d3c4dd764ac4f766a0595ed0, disabling compactions & flushes 2023-02-13 10:11:18,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. after waiting 0 ms 2023-02-13 10:11:18,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testCompactionWithHFileLink/fb0bfb57d3c4dd764ac4f766a0595ed0/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 10:11:18,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for fb0bfb57d3c4dd764ac4f766a0595ed0: Waiting for close lock at 1676283078683Running coprocessor pre-close hooks at 1676283078683Disabling compacts and flushes for region at 1676283078683Disabling writes for close at 1676283078683Writing region close event to WAL at 1676283078684 (+1 ms)Running coprocessor post-close hooks at 1676283078688 (+4 ms)Closed at 1676283078688 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676282991598.fb0bfb57d3c4dd764ac4f766a0595ed0. 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing b9edb4a3c4d71f1ff09d06871e99ec1b, disabling compactions & flushes 2023-02-13 10:11:18,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. after waiting 0 ms 2023-02-13 10:11:18,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:18,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/b9edb4a3c4d71f1ff09d06871e99ec1b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:18,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for b9edb4a3c4d71f1ff09d06871e99ec1b: Waiting for close lock at 1676283078688Running coprocessor pre-close hooks at 1676283078688Disabling compacts and flushes for region at 1676283078688Disabling writes for close at 1676283078688Writing region close event to WAL at 1676283078689 (+1 ms)Running coprocessor post-close hooks at 1676283078691 (+2 ms)Closed at 1676283078691 2023-02-13 10:11:18,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676283055838.b9edb4a3c4d71f1ff09d06871e99ec1b. 2023-02-13 10:11:18,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing f822e7441393470eb937d55672c0347b, disabling compactions & flushes 2023-02-13 10:11:18,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:11:18,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:11:18,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. after waiting 0 ms 2023-02-13 10:11:18,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:11:18,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithWeeklyPolicy/f822e7441393470eb937d55672c0347b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 10:11:18,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:11:18,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for f822e7441393470eb937d55672c0347b: Waiting for close lock at 1676283078691Running coprocessor pre-close hooks at 1676283078691Disabling compacts and flushes for region at 1676283078691Disabling writes for close at 1676283078692 (+1 ms)Writing region close event to WAL at 1676283078692Running coprocessor post-close hooks at 1676283078694 (+2 ms)Closed at 1676283078694 2023-02-13 10:11:18,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676282936068.f822e7441393470eb937d55672c0347b. 2023-02-13 10:11:18,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1cad52cf8b278bc4b5803d83efcec02c, disabling compactions & flushes 2023-02-13 10:11:18,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:11:18,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:11:18,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. after waiting 0 ms 2023-02-13 10:11:18,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionWithMonthlyPolicy/1cad52cf8b278bc4b5803d83efcec02c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 10:11:18,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1cad52cf8b278bc4b5803d83efcec02c: Waiting for close lock at 1676283078695Running coprocessor pre-close hooks at 1676283078695Disabling compacts and flushes for region at 1676283078695Disabling writes for close at 1676283078695Writing region close event to WAL at 1676283078695Running coprocessor post-close hooks at 1676283078697 (+2 ms)Closed at 1676283078697 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676282901937.1cad52cf8b278bc4b5803d83efcec02c. 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 3a5cd0a3e9fc007920bb491a68f2767b, disabling compactions & flushes 2023-02-13 10:11:18,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. after waiting 0 ms 2023-02-13 10:11:18,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/default/testMajorCompactionFromAdmin/3a5cd0a3e9fc007920bb491a68f2767b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 10:11:18,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 3a5cd0a3e9fc007920bb491a68f2767b: Waiting for close lock at 1676283078697Running coprocessor pre-close hooks at 1676283078697Disabling compacts and flushes for region at 1676283078697Disabling writes for close at 1676283078697Writing region close event to WAL at 1676283078698 (+1 ms)Running coprocessor post-close hooks at 1676283078700 (+2 ms)Closed at 1676283078700 2023-02-13 10:11:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676283055838.3a5cd0a3e9fc007920bb491a68f2767b. 2023-02-13 10:11:18,803 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 10:11:19,004 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 10:11:19,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/rep_barrier/ed612b8fe1cb4439a2dc4f701fcaacda 2023-02-13 10:11:19,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed612b8fe1cb4439a2dc4f701fcaacda 2023-02-13 10:11:19,090 INFO [regionserver/jenkins-hbase16:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 10:11:19,090 INFO [regionserver/jenkins-hbase16:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 10:11:19,204 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 10:11:19,204 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 10:11:19,204 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 10:11:19,405 DEBUG [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 10:11:19,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/table/1dcb2394915140abbde3aef256fbf135 2023-02-13 10:11:19,469 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dcb2394915140abbde3aef256fbf135 2023-02-13 10:11:19,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/info/ca6336d24bca48398c16ab2443da6b1e as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/info/ca6336d24bca48398c16ab2443da6b1e 2023-02-13 10:11:19,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca6336d24bca48398c16ab2443da6b1e 2023-02-13 10:11:19,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/info/ca6336d24bca48398c16ab2443da6b1e, entries=226, sequenceid=130, filesize=37.9 K 2023-02-13 10:11:19,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/rep_barrier/ed612b8fe1cb4439a2dc4f701fcaacda as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/rep_barrier/ed612b8fe1cb4439a2dc4f701fcaacda 2023-02-13 10:11:19,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed612b8fe1cb4439a2dc4f701fcaacda 2023-02-13 10:11:19,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/rep_barrier/ed612b8fe1cb4439a2dc4f701fcaacda, entries=1, sequenceid=130, filesize=5.0 K 2023-02-13 10:11:19,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/.tmp/table/1dcb2394915140abbde3aef256fbf135 as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/table/1dcb2394915140abbde3aef256fbf135 2023-02-13 10:11:19,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dcb2394915140abbde3aef256fbf135 2023-02-13 10:11:19,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/table/1dcb2394915140abbde3aef256fbf135, entries=27, sequenceid=130, filesize=6.6 K 2023-02-13 10:11:19,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1283ms, sequenceid=130, compaction requested=false 2023-02-13 10:11:19,489 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-13 10:11:19,489 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 10:11:19,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 10:11:19,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676283078201Running coprocessor pre-close hooks at 1676283078201Disabling compacts and flushes for region at 1676283078201Disabling writes for close at 1676283078202 (+1 ms)Obtaining lock to block concurrent updates at 1676283078202Preparing flush snapshotting stores in 1588230740 at 1676283078202Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676283078202Flushing stores of hbase:meta,,1.1588230740 at 1676283078202Flushing 1588230740/info: creating writer at 1676283078203 (+1 ms)Flushing 1588230740/info: appending metadata at 1676283078209 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676283078209Flushing 1588230740/rep_barrier: creating writer at 1676283078624 (+415 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676283078627 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676283078627Flushing 1588230740/table: creating writer at 1676283079044 (+417 ms)Flushing 1588230740/table: appending metadata at 1676283079047 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676283079047Flushing 1588230740/info: reopening flushed file at 1676283079472 (+425 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676283079477 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676283079481 (+4 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1283ms, sequenceid=130, compaction requested=false at 1676283079486 (+5 ms)Writing region close event to WAL at 1676283079487 (+1 ms)Running coprocessor post-close hooks at 1676283079489 (+2 ms)Closed at 1676283079490 (+1 ms) 2023-02-13 10:11:19,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 10:11:19,605 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1171): stopping server jenkins-hbase16.apache.org,38311,1676282881622; all regions closed. 2023-02-13 10:11:19,614 DEBUG [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/oldWALs 2023-02-13 10:11:19,614 INFO [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C38311%2C1676282881622.meta:.meta(num 1676282884876) 2023-02-13 10:11:19,620 DEBUG [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/oldWALs 2023-02-13 10:11:19,620 INFO [RS:0;jenkins-hbase16:38311] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C38311%2C1676282881622:(num 1676282884237) 2023-02-13 10:11:19,620 DEBUG [RS:0;jenkins-hbase16:38311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:19,620 INFO [RS:0;jenkins-hbase16:38311] regionserver.LeaseManager(133): Closed leases 2023-02-13 10:11:19,621 INFO [RS:0;jenkins-hbase16:38311] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 10:11:19,621 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 10:11:19,622 INFO [RS:0;jenkins-hbase16:38311] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:38311 2023-02-13 10:11:19,637 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,38311,1676282881622 2023-02-13 10:11:19,638 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38040260 rejected from java.util.concurrent.ThreadPoolExecutor@3c3b81b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,638 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 10:11:19,637 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 10:11:19,638 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5005381e rejected from java.util.concurrent.ThreadPoolExecutor@3c3b81b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,646 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,38311,1676282881622] 2023-02-13 10:11:19,647 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,38311,1676282881622; numProcessing=1 2023-02-13 10:11:19,654 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,38311,1676282881622 already deleted, retry=false 2023-02-13 10:11:19,654 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,38311,1676282881622 expired; onlineServers=0 2023-02-13 10:11:19,654 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase16.apache.org,42277,1676282880018' ***** 2023-02-13 10:11:19,654 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 10:11:19,655 DEBUG [M:0;jenkins-hbase16:42277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a261ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-02-13 10:11:19,655 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegionServer(1145): stopping server jenkins-hbase16.apache.org,42277,1676282880018 2023-02-13 10:11:19,655 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegionServer(1171): stopping server jenkins-hbase16.apache.org,42277,1676282880018; all regions closed. 2023-02-13 10:11:19,655 DEBUG [M:0;jenkins-hbase16:42277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 10:11:19,655 DEBUG [M:0;jenkins-hbase16:42277] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 10:11:19,656 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 10:11:19,656 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676282883956] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676282883956,5,FailOnTimeoutGroup] 2023-02-13 10:11:19,656 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676282883955] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676282883955,5,FailOnTimeoutGroup] 2023-02-13 10:11:19,656 DEBUG [M:0;jenkins-hbase16:42277] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 10:11:19,656 INFO [M:0;jenkins-hbase16:42277] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 10:11:19,656 INFO [M:0;jenkins-hbase16:42277] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 10:11:19,657 INFO [M:0;jenkins-hbase16:42277] hbase.ChoreService(369): Chore service for: master/jenkins-hbase16:0 had [] on shutdown 2023-02-13 10:11:19,657 DEBUG [M:0;jenkins-hbase16:42277] master.HMaster(1502): Stopping service threads 2023-02-13 10:11:19,658 INFO [M:0;jenkins-hbase16:42277] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 10:11:19,658 ERROR [M:0;jenkins-hbase16:42277] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-13 10:11:19,659 INFO [M:0;jenkins-hbase16:42277] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 10:11:19,659 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 10:11:19,663 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 10:11:19,663 DEBUG [M:0;jenkins-hbase16:42277] zookeeper.ZKUtil(398): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 10:11:19,663 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 10:11:19,663 WARN [M:0;jenkins-hbase16:42277] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 10:11:19,663 INFO [M:0;jenkins-hbase16:42277] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 10:11:19,663 INFO [M:0;jenkins-hbase16:42277] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 10:11:19,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 10:11:19,664 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 10:11:19,664 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:11:19,664 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:11:19,664 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 10:11:19,664 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:11:19,664 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.48 KB heapSize=599.70 KB 2023-02-13 10:11:19,673 INFO [M:0;jenkins-hbase16:42277] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.48 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/84f63c663f70480c8b4d67cf872dab9a 2023-02-13 10:11:19,676 INFO [M:0;jenkins-hbase16:42277] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84f63c663f70480c8b4d67cf872dab9a 2023-02-13 10:11:19,677 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/84f63c663f70480c8b4d67cf872dab9a as hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/84f63c663f70480c8b4d67cf872dab9a 2023-02-13 10:11:19,681 INFO [M:0;jenkins-hbase16:42277] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84f63c663f70480c8b4d67cf872dab9a 2023-02-13 10:11:19,681 INFO [M:0;jenkins-hbase16:42277] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34273/user/jenkins/test-data/6a25cc98-69c0-a340-7574-fe48e7e4fdcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/84f63c663f70480c8b4d67cf872dab9a, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-13 10:11:19,682 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegion(2947): Finished flush of dataSize ~513.48 KB/525805, heapSize ~599.68 KB/614072, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=1011, compaction requested=false 2023-02-13 10:11:19,682 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 10:11:19,682 DEBUG [M:0;jenkins-hbase16:42277] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676283079664Disabling compacts and flushes for region at 1676283079664Disabling writes for close at 1676283079664Obtaining lock to block concurrent updates at 1676283079664Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676283079664Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525805, getHeapSize=614072, getOffHeapSize=0, getCellsCount=1166 at 1676283079665 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676283079665Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676283079665Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676283079668 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676283079668Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676283079678 (+10 ms)Finished flush of dataSize ~513.48 KB/525805, heapSize ~599.68 KB/614072, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=1011, compaction requested=false at 1676283079682 (+4 ms)Writing region close event to WAL at 1676283079682Closed at 1676283079682 2023-02-13 10:11:19,684 INFO [M:0;jenkins-hbase16:42277] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 10:11:19,684 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 10:11:19,685 INFO [M:0;jenkins-hbase16:42277] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:42277 2023-02-13 10:11:19,695 DEBUG [M:0;jenkins-hbase16:42277] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase16.apache.org,42277,1676282880018 already deleted, retry=false 2023-02-13 10:11:19,746 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 10:11:19,746 INFO [RS:0;jenkins-hbase16:38311] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase16.apache.org,38311,1676282881622; zookeeper connection closed. 2023-02-13 10:11:19,746 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28dc5984 rejected from java.util.concurrent.ThreadPoolExecutor@3c3b81b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,747 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): regionserver:38311-0x100525c4b260001, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 10:11:19,747 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@80625a4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@80625a4 2023-02-13 10:11:19,747 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@602ae9e0 rejected from java.util.concurrent.ThreadPoolExecutor@3c3b81b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,747 INFO [Listener at localhost.localdomain/39579] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-13 10:11:19,846 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 10:11:19,846 INFO [M:0;jenkins-hbase16:42277] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase16.apache.org,42277,1676282880018; zookeeper connection closed. 2023-02-13 10:11:19,847 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a198ad5 rejected from java.util.concurrent.ThreadPoolExecutor@25f10bef[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,847 DEBUG [Listener at localhost.localdomain/39579-EventThread] zookeeper.ZKWatcher(600): master:42277-0x100525c4b260000, quorum=127.0.0.1:57475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 10:11:19,847 ERROR [Listener at localhost.localdomain/39579-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45ef5f01 rejected from java.util.concurrent.ThreadPoolExecutor@25f10bef[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 10:11:19,850 WARN [Listener at localhost.localdomain/39579] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 10:11:19,856 INFO [Listener at localhost.localdomain/39579] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 10:11:19,970 WARN [BP-1454032713-188.40.62.62-1676282876222 heartbeating to localhost.localdomain/127.0.0.1:34273] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 10:11:19,970 WARN [BP-1454032713-188.40.62.62-1676282876222 heartbeating to localhost.localdomain/127.0.0.1:34273] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1454032713-188.40.62.62-1676282876222 (Datanode Uuid 8cc9e15e-da6d-4d2a-b34f-70a90b09d31e) service to localhost.localdomain/127.0.0.1:34273 2023-02-13 10:11:19,973 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/dfs/data/data1/current/BP-1454032713-188.40.62.62-1676282876222] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 10:11:19,974 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/730f3e24-791e-7b3c-8219-01c0207c840e/cluster_676dcfae-3c26-80f1-4f70-55dbfe17632b/dfs/data/data2/current/BP-1454032713-188.40.62.62-1676282876222] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 10:11:19,995 INFO [Listener at localhost.localdomain/39579] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 10:11:20,131 INFO [Listener at localhost.localdomain/39579] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 10:11:20,221 INFO [Listener at localhost.localdomain/39579] hbase.HBaseTestingUtility(1293): Minicluster is down