2023-11-03 13:53:57,322 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-03 13:53:57,823 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2 2023-11-03 13:53:57,854 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-03 13:53:57,855 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1, deleteOnExit=true 2023-11-03 13:53:57,855 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-03 13:53:57,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/test.cache.data in system properties and HBase conf 2023-11-03 13:53:57,857 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/hadoop.tmp.dir in system properties and HBase conf 2023-11-03 13:53:57,858 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/hadoop.log.dir in system properties and HBase conf 2023-11-03 13:53:57,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-03 13:53:57,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-03 13:53:57,860 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-03 13:53:58,240 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-03 13:53:59,058 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-03 13:53:59,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-03 13:53:59,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-03 13:53:59,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-03 13:53:59,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-03 13:53:59,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-03 13:53:59,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-03 13:53:59,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-03 13:53:59,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-03 13:53:59,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-03 13:53:59,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/nfs.dump.dir in system properties and HBase conf 2023-11-03 13:53:59,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/java.io.tmpdir in system properties and HBase conf 2023-11-03 13:53:59,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-03 13:53:59,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-03 13:53:59,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-03 13:54:00,336 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-03 13:54:00,348 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-03 13:54:01,020 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-03 13:54:01,480 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-03 13:54:01,520 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-03 13:54:01,605 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-03 13:54:01,687 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/java.io.tmpdir/Jetty_localhost_42229_hdfs____.20lw9n/webapp 2023-11-03 13:54:02,021 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42229 2023-11-03 13:54:02,044 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-03 13:54:02,044 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-03 13:54:03,364 WARN [Listener at localhost/35135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-03 13:54:03,715 WARN [Listener at localhost/35135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-03 13:54:03,771 WARN [Listener at localhost/35135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-03 13:54:03,784 INFO [Listener at localhost/35135] log.Slf4jLog(67): jetty-6.1.26 2023-11-03 13:54:03,811 INFO [Listener at localhost/35135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/java.io.tmpdir/Jetty_localhost_35635_datanode____.m8o9lv/webapp 2023-11-03 13:54:03,987 INFO [Listener at localhost/35135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35635 2023-11-03 13:54:04,648 WARN [Listener at localhost/39963] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-03 13:54:06,109 DEBUG [Listener at localhost/39963] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2 2023-11-03 13:54:06,133 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae27b06ca57ec0ed: Processing first storage report for DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9 from datanode 7ee4b17e-5547-4b38-9c91-4ae2fa68c6fd 2023-11-03 13:54:06,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae27b06ca57ec0ed: from storage DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9 node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=7ee4b17e-5547-4b38-9c91-4ae2fa68c6fd, infoPort=34955, infoSecurePort=0, ipcPort=39963, storageInfo=lv=-57;cid=testClusterID;nsid=308973154;c=1699019640487), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-03 13:54:06,138 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae27b06ca57ec0ed: Processing first storage report for DS-89534388-fbe9-44e6-af89-24575ca41dcd from datanode 7ee4b17e-5547-4b38-9c91-4ae2fa68c6fd 2023-11-03 13:54:06,138 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae27b06ca57ec0ed: from storage DS-89534388-fbe9-44e6-af89-24575ca41dcd node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=7ee4b17e-5547-4b38-9c91-4ae2fa68c6fd, infoPort=34955, infoSecurePort=0, ipcPort=39963, storageInfo=lv=-57;cid=testClusterID;nsid=308973154;c=1699019640487), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-03 13:54:06,462 INFO [Listener at localhost/39963] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/zookeeper_0, clientPort=53668, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-03 13:54:06,501 INFO [Listener at localhost/39963] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53668 2023-11-03 13:54:06,515 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:06,518 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:07,537 INFO [Listener at localhost/39963] util.FSUtils(471): Created version file at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1 with version=8 2023-11-03 13:54:07,537 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/hbase-staging 2023-11-03 13:54:08,080 INFO [Listener at localhost/39963] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-03 13:54:08,929 INFO [Listener at localhost/39963] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-11-03 13:54:08,975 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:08,976 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:08,976 INFO [Listener at localhost/39963] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-03 13:54:08,977 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:08,977 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-03 13:54:09,236 INFO [Listener at localhost/39963] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-03 13:54:09,346 DEBUG [Listener at localhost/39963] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-03 13:54:09,518 INFO [Listener at localhost/39963] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45993 2023-11-03 13:54:09,536 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:09,540 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:09,578 INFO [Listener at localhost/39963] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45993 connecting to ZooKeeper ensemble=127.0.0.1:53668 2023-11-03 13:54:09,713 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:459930x0, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-03 13:54:09,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45993-0x10197b936ac0000 connected 2023-11-03 13:54:10,056 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-03 13:54:10,066 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-03 13:54:10,074 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-03 13:54:10,100 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45993 2023-11-03 13:54:10,102 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45993 2023-11-03 13:54:10,110 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45993 2023-11-03 13:54:10,118 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45993 2023-11-03 13:54:10,122 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45993 2023-11-03 13:54:10,135 INFO [Listener at localhost/39963] master.HMaster(444): hbase.rootdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1, hbase.cluster.distributed=false 2023-11-03 13:54:10,289 INFO [Listener at localhost/39963] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-11-03 13:54:10,290 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:10,290 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:10,291 INFO [Listener at localhost/39963] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-03 13:54:10,291 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-03 13:54:10,291 INFO [Listener at localhost/39963] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-03 13:54:10,298 INFO [Listener at localhost/39963] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-03 13:54:10,308 INFO [Listener at localhost/39963] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46707 2023-11-03 13:54:10,311 INFO [Listener at localhost/39963] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-03 13:54:10,346 DEBUG [Listener at localhost/39963] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-03 13:54:10,348 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:10,358 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:10,373 INFO [Listener at localhost/39963] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46707 connecting to ZooKeeper ensemble=127.0.0.1:53668 2023-11-03 13:54:10,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:467070x0, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-03 13:54:10,433 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): regionserver:467070x0, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-03 13:54:10,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46707-0x10197b936ac0001 connected 2023-11-03 13:54:10,442 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-03 13:54:10,454 DEBUG [Listener at localhost/39963] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-03 13:54:10,467 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46707 2023-11-03 13:54:10,491 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46707 2023-11-03 13:54:10,504 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46707 2023-11-03 13:54:10,526 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46707 2023-11-03 13:54:10,527 DEBUG [Listener at localhost/39963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46707 2023-11-03 13:54:10,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:10,583 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-03 13:54:10,602 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:10,667 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-03 13:54:10,670 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-03 13:54:10,670 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:10,675 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-03 13:54:10,699 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,45993,1699019647783 from backup master directory 2023-11-03 13:54:10,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-03 13:54:10,715 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:10,715 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-03 13:54:10,718 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-03 13:54:10,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:10,730 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-03 13:54:10,736 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-03 13:54:11,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/hbase.id with ID: e39a5467-8791-4f19-ad83-216a3b37e884 2023-11-03 13:54:11,632 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:11,688 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:11,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4214424e to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:11,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70144d77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:11,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-03 13:54:11,992 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-03 13:54:12,024 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-03 13:54:12,024 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-03 13:54:12,028 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-03 13:54:12,042 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-03 13:54:12,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-03 13:54:12,147 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store-tmp 2023-11-03 13:54:12,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:12,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-03 13:54:12,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:54:12,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:54:12,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-03 13:54:12,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:54:12,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:54:12,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-03 13:54:12,296 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/WALs/jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:12,335 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45993%2C1699019647783, suffix=, logDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/WALs/jenkins-hbase20.apache.org,45993,1699019647783, archiveDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/oldWALs, maxLogs=10 2023-11-03 13:54:12,453 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK] 2023-11-03 13:54:12,468 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-03 13:54:12,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/WALs/jenkins-hbase20.apache.org,45993,1699019647783/jenkins-hbase20.apache.org%2C45993%2C1699019647783.1699019652348 2023-11-03 13:54:12,637 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK]] 2023-11-03 13:54:12,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:12,639 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:12,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,773 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,783 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-03 13:54:12,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-03 13:54:12,832 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:12,843 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,845 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,905 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-03 13:54:12,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:12,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66421903, jitterRate=-0.01023651659488678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:12,942 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-03 13:54:12,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-03 13:54:12,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-03 13:54:12,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-03 13:54:12,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-03 13:54:12,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-03 13:54:13,024 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 48 msec 2023-11-03 13:54:13,024 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-03 13:54:13,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-03 13:54:13,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-03 13:54:13,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-03 13:54:13,129 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-03 13:54:13,136 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-03 13:54:13,142 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-03 13:54:13,157 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-03 13:54:13,165 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:13,171 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-03 13:54:13,174 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-03 13:54:13,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-03 13:54:13,214 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-03 13:54:13,214 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-03 13:54:13,214 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:13,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,45993,1699019647783, sessionid=0x10197b936ac0000, setting cluster-up flag (Was=false) 2023-11-03 13:54:13,257 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:13,265 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-03 13:54:13,275 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:13,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:13,338 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-03 13:54:13,367 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:13,374 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp 2023-11-03 13:54:13,463 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(951): ClusterId : e39a5467-8791-4f19-ad83-216a3b37e884 2023-11-03 13:54:13,470 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-03 13:54:13,476 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-03 13:54:13,477 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-03 13:54:13,495 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-03 13:54:13,499 DEBUG [RS:0;jenkins-hbase20:46707] zookeeper.ReadOnlyZKClient(139): Connect 0x65c744bb to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:13,523 DEBUG [RS:0;jenkins-hbase20:46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b00b673, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:13,524 DEBUG [RS:0;jenkins-hbase20:46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f3f2fcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-03 13:54:13,564 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:46707 2023-11-03 13:54:13,568 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-03 13:54:13,572 INFO [RS:0;jenkins-hbase20:46707] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-03 13:54:13,572 INFO [RS:0;jenkins-hbase20:46707] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-03 13:54:13,572 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1022): About to register with Master. 2023-11-03 13:54:13,578 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,45993,1699019647783 with isa=jenkins-hbase20.apache.org/148.251.75.209:46707, startcode=1699019650288 2023-11-03 13:54:13,598 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-03 13:54:13,598 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-03 13:54:13,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,617 DEBUG [RS:0;jenkins-hbase20:46707] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-03 13:54:13,631 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699019683630 2023-11-03 13:54:13,633 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-03 13:54:13,635 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-03 13:54:13,636 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-03 13:54:13,644 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-03 13:54:13,662 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-03 13:54:13,682 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-03 13:54:13,688 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-03 13:54:13,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-03 13:54:13,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-03 13:54:13,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,693 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-03 13:54:13,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-03 13:54:13,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-03 13:54:13,701 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-03 13:54:13,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-03 13:54:13,722 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699019653719,5,FailOnTimeoutGroup] 2023-11-03 13:54:13,734 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699019653723,5,FailOnTimeoutGroup] 2023-11-03 13:54:13,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-03 13:54:13,747 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,765 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:13,770 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51681, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-03 13:54:13,771 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:13,771 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1 2023-11-03 13:54:13,790 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45993] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,806 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1 2023-11-03 13:54:13,806 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35135 2023-11-03 13:54:13,806 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-03 13:54:13,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-03 13:54:13,860 DEBUG [RS:0;jenkins-hbase20:46707] zookeeper.ZKUtil(162): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,860 WARN [RS:0;jenkins-hbase20:46707] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-03 13:54:13,861 INFO [RS:0;jenkins-hbase20:46707] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-03 13:54:13,862 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/WALs/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,862 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46707,1699019650288] 2023-11-03 13:54:13,875 DEBUG [RS:0;jenkins-hbase20:46707] zookeeper.ZKUtil(162): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,886 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-03 13:54:13,894 INFO [RS:0;jenkins-hbase20:46707] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-03 13:54:13,913 INFO [RS:0;jenkins-hbase20:46707] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-03 13:54:13,916 INFO [RS:0;jenkins-hbase20:46707] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:54:13,916 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,918 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-03 13:54:13,925 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,926 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,926 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,926 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,926 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,926 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,927 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-03 13:54:13,927 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,927 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,927 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,927 DEBUG [RS:0;jenkins-hbase20:46707] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-03 13:54:13,928 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,928 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,929 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,943 INFO [RS:0;jenkins-hbase20:46707] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-03 13:54:13,945 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46707,1699019650288-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:13,958 INFO [RS:0;jenkins-hbase20:46707] regionserver.Replication(203): jenkins-hbase20.apache.org,46707,1699019650288 started 2023-11-03 13:54:13,958 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,46707,1699019650288, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46707, sessionid=0x10197b936ac0001 2023-11-03 13:54:13,959 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-03 13:54:13,959 DEBUG [RS:0;jenkins-hbase20:46707] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,959 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46707,1699019650288' 2023-11-03 13:54:13,959 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46707,1699019650288' 2023-11-03 13:54:13,960 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-03 13:54:13,961 DEBUG [RS:0;jenkins-hbase20:46707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-03 13:54:13,962 DEBUG [RS:0;jenkins-hbase20:46707] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-03 13:54:13,962 INFO [RS:0;jenkins-hbase20:46707] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-03 13:54:13,962 INFO [RS:0;jenkins-hbase20:46707] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-03 13:54:14,079 INFO [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46707%2C1699019650288, suffix=, logDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/WALs/jenkins-hbase20.apache.org,46707,1699019650288, archiveDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/oldWALs, maxLogs=32 2023-11-03 13:54:14,098 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK] 2023-11-03 13:54:14,101 INFO [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/WALs/jenkins-hbase20.apache.org,46707,1699019650288/jenkins-hbase20.apache.org%2C46707%2C1699019650288.1699019654082 2023-11-03 13:54:14,102 DEBUG [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK]] 2023-11-03 13:54:14,195 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:14,198 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-03 13:54:14,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/info 2023-11-03 13:54:14,202 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-03 13:54:14,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-03 13:54:14,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/rep_barrier 2023-11-03 13:54:14,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-03 13:54:14,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-03 13:54:14,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/table 2023-11-03 13:54:14,213 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-03 13:54:14,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,215 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740 2023-11-03 13:54:14,216 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740 2023-11-03 13:54:14,219 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-03 13:54:14,222 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-03 13:54:14,226 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:14,228 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63988259, jitterRate=-0.046500638127326965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-03 13:54:14,228 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-03 13:54:14,228 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-03 13:54:14,228 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-03 13:54:14,228 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-03 13:54:14,228 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-03 13:54:14,228 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-03 13:54:14,230 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-03 13:54:14,230 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-03 13:54:14,236 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-03 13:54:14,236 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-03 13:54:14,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-03 13:54:14,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-03 13:54:14,256 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-03 13:54:14,410 DEBUG [jenkins-hbase20:45993] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-03 13:54:14,414 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46707,1699019650288, state=OPENING 2023-11-03 13:54:14,424 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-03 13:54:14,427 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:14,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:14,432 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-03 13:54:14,629 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:14,632 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-03 13:54:14,637 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-03 13:54:14,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-03 13:54:14,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-03 13:54:14,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46707%2C1699019650288.meta, suffix=.meta, logDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/WALs/jenkins-hbase20.apache.org,46707,1699019650288, archiveDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/oldWALs, maxLogs=32 2023-11-03 13:54:14,752 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK] 2023-11-03 13:54:14,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/WALs/jenkins-hbase20.apache.org,46707,1699019650288/jenkins-hbase20.apache.org%2C46707%2C1699019650288.meta.1699019654695.meta 2023-11-03 13:54:14,782 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41167,DS-d5562c4a-ac18-44fd-8f8b-8ce69c94b8a9,DISK]] 2023-11-03 13:54:14,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:14,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-03 13:54:14,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-03 13:54:14,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-03 13:54:14,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-03 13:54:14,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:14,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-03 13:54:14,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-03 13:54:14,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-03 13:54:14,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/info 2023-11-03 13:54:14,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/info 2023-11-03 13:54:14,832 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-03 13:54:14,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-03 13:54:14,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/rep_barrier 2023-11-03 13:54:14,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/rep_barrier 2023-11-03 13:54:14,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-03 13:54:14,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-03 13:54:14,843 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/table 2023-11-03 13:54:14,843 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/table 2023-11-03 13:54:14,845 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-03 13:54:14,846 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:14,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740 2023-11-03 13:54:14,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740 2023-11-03 13:54:14,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-03 13:54:14,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-03 13:54:14,875 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61173051, jitterRate=-0.08845050632953644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-03 13:54:14,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-03 13:54:14,889 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699019654619 2023-11-03 13:54:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-03 13:54:14,915 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46707,1699019650288, state=OPEN 2023-11-03 13:54:14,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-03 13:54:14,936 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-03 13:54:14,936 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-03 13:54:14,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-03 13:54:14,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46707,1699019650288 in 505 msec 2023-11-03 13:54:14,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-03 13:54:14,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 711 msec 2023-11-03 13:54:15,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5260 sec 2023-11-03 13:54:15,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699019655049, completionTime=-1 2023-11-03 13:54:15,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-03 13:54:15,050 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-03 13:54:15,215 DEBUG [hconnection-0x16c0f3a4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:15,234 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:15,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-03 13:54:15,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699019715283 2023-11-03 13:54:15,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699019775283 2023-11-03 13:54:15,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 233 msec 2023-11-03 13:54:15,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45993,1699019647783-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:15,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45993,1699019647783-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:15,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45993,1699019647783-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:15,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:45993, period=300000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:15,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-03 13:54:15,368 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-03 13:54:15,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-03 13:54:15,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-03 13:54:15,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-03 13:54:15,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:15,418 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:15,450 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:15,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf empty. 2023-11-03 13:54:15,455 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:15,457 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-03 13:54:15,493 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:15,496 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => aaa7e5a05e5ae46b673f2a4aa2c44abf, NAME => 'hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:15,943 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:15,944 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing aaa7e5a05e5ae46b673f2a4aa2c44abf, disabling compactions & flushes 2023-11-03 13:54:15,944 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:15,944 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:15,944 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. after waiting 0 ms 2023-11-03 13:54:15,944 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:15,944 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:15,944 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for aaa7e5a05e5ae46b673f2a4aa2c44abf: 2023-11-03 13:54:15,956 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:15,983 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699019655963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019655963"}]},"ts":"1699019655963"} 2023-11-03 13:54:16,033 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:54:16,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:16,046 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019656039"}]},"ts":"1699019656039"} 2023-11-03 13:54:16,056 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-03 13:54:16,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aaa7e5a05e5ae46b673f2a4aa2c44abf, ASSIGN}] 2023-11-03 13:54:16,085 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aaa7e5a05e5ae46b673f2a4aa2c44abf, ASSIGN 2023-11-03 13:54:16,088 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=aaa7e5a05e5ae46b673f2a4aa2c44abf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:16,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aaa7e5a05e5ae46b673f2a4aa2c44abf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:16,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699019656239"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019656239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019656239"}]},"ts":"1699019656239"} 2023-11-03 13:54:16,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure aaa7e5a05e5ae46b673f2a4aa2c44abf, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:16,405 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:16,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:16,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aaa7e5a05e5ae46b673f2a4aa2c44abf, NAME => 'hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:16,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:16,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,418 INFO [StoreOpener-aaa7e5a05e5ae46b673f2a4aa2c44abf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,421 DEBUG [StoreOpener-aaa7e5a05e5ae46b673f2a4aa2c44abf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/info 2023-11-03 13:54:16,421 DEBUG [StoreOpener-aaa7e5a05e5ae46b673f2a4aa2c44abf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/info 2023-11-03 13:54:16,422 INFO [StoreOpener-aaa7e5a05e5ae46b673f2a4aa2c44abf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa7e5a05e5ae46b673f2a4aa2c44abf columnFamilyName info 2023-11-03 13:54:16,423 INFO [StoreOpener-aaa7e5a05e5ae46b673f2a4aa2c44abf-1] regionserver.HStore(310): Store=aaa7e5a05e5ae46b673f2a4aa2c44abf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:16,426 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:54:16,447 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:16,448 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aaa7e5a05e5ae46b673f2a4aa2c44abf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68600127, jitterRate=0.022221550345420837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:16,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aaa7e5a05e5ae46b673f2a4aa2c44abf: 2023-11-03 13:54:16,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf., pid=6, masterSystemTime=1699019656405 2023-11-03 13:54:16,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:16,457 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:54:16,458 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aaa7e5a05e5ae46b673f2a4aa2c44abf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:16,459 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699019656458"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019656458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019656458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019656458"}]},"ts":"1699019656458"} 2023-11-03 13:54:16,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-03 13:54:16,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure aaa7e5a05e5ae46b673f2a4aa2c44abf, server=jenkins-hbase20.apache.org,46707,1699019650288 in 217 msec 2023-11-03 13:54:16,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-03 13:54:16,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=aaa7e5a05e5ae46b673f2a4aa2c44abf, ASSIGN in 390 msec 2023-11-03 13:54:16,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:54:16,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019656487"}]},"ts":"1699019656487"} 2023-11-03 13:54:16,496 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-03 13:54:16,505 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:54:16,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.1130 sec 2023-11-03 13:54:16,514 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-03 13:54:16,517 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-03 13:54:16,518 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:54:16,609 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-03 13:54:16,671 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-03 13:54:16,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-03 13:54:16,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 101 msec 2023-11-03 13:54:16,710 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-03 13:54:16,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-03 13:54:16,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 55 msec 2023-11-03 13:54:16,783 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-03 13:54:16,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-03 13:54:16,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 6.073sec 2023-11-03 13:54:16,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-03 13:54:16,795 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-03 13:54:16,795 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-03 13:54:16,796 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45993,1699019647783-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-03 13:54:16,797 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45993,1699019647783-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-03 13:54:16,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-03 13:54:16,886 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(139): Connect 0x5b326aed to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:16,902 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8f5e5c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:16,935 DEBUG [hconnection-0x4488c899-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:16,966 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:16,989 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:54:16,993 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(139): Connect 0x1404b169 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:17,026 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b9ce4c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:17,027 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:54:17,122 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=1780, ProcessCount=194, AvailableMemoryMB=263 2023-11-03 13:54:17,150 DEBUG [Listener at localhost/39963] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:17,167 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:17,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:54:17,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:17,202 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:17,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-03 13:54:17,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:17,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-03 13:54:17,240 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,246 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 empty. 2023-11-03 13:54:17,251 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-03 13:54:17,325 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:17,335 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 38279015a373f34c66be1e5fe643de64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-03 13:54:17,398 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:17,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 38279015a373f34c66be1e5fe643de64, disabling compactions & flushes 2023-11-03 13:54:17,399 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. after waiting 0 ms 2023-11-03 13:54:17,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,399 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:17,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:17,410 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019657409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019657409"}]},"ts":"1699019657409"} 2023-11-03 13:54:17,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:54:17,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:17,424 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019657424"}]},"ts":"1699019657424"} 2023-11-03 13:54:17,428 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-03 13:54:17,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, ASSIGN}] 2023-11-03 13:54:17,440 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, ASSIGN 2023-11-03 13:54:17,449 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:17,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-03 13:54:17,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:17,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019657601"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019657601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019657601"}]},"ts":"1699019657601"} 2023-11-03 13:54:17,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:17,761 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:17,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38279015a373f34c66be1e5fe643de64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:17,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:17,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,786 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,791 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:17,792 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:17,795 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38279015a373f34c66be1e5fe643de64 columnFamilyName family1 2023-11-03 13:54:17,800 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(310): Store=38279015a373f34c66be1e5fe643de64/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:17,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:17,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:17,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 38279015a373f34c66be1e5fe643de64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58885254, jitterRate=-0.12254133820533752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:17,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:17,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., pid=11, masterSystemTime=1699019657761 2023-11-03 13:54:17,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:17,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:17,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019657843"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019657843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019657843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019657843"}]},"ts":"1699019657843"} 2023-11-03 13:54:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-03 13:54:17,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-03 13:54:17,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288 in 246 msec 2023-11-03 13:54:17,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-03 13:54:17,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, ASSIGN in 425 msec 2023-11-03 13:54:17,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:54:17,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019657863"}]},"ts":"1699019657863"} 2023-11-03 13:54:17,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-03 13:54:17,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:54:17,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 676 msec 2023-11-03 13:54:18,073 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-03 13:54:18,074 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-03 13:54:18,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-03 13:54:18,363 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-03 13:54:18,392 DEBUG [hconnection-0x56228d98-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:18,396 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:18,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,653 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:18,654 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:18,655 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:18,655 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:18,658 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,658 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,666 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:18,668 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:18,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:18,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:18,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:18,680 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:18,680 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:18,682 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:18,686 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:18,686 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:18,688 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:18,690 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:18,692 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:54:19,493 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d8152f32f4b340759811beb1dbf4a075 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d8152f32f4b340759811beb1dbf4a075 2023-11-03 13:54:19,542 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/030586a55dc841dabba94fb8b884f723 2023-11-03 13:54:19,573 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/030586a55dc841dabba94fb8b884f723 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723 2023-11-03 13:54:19,593 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-03 13:54:19,605 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 914ms, sequenceid=5, compaction requested=false 2023-11-03 13:54:19,607 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:19,614 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:19,614 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:19,614 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:19,615 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:19,615 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,616 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:19,616 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:19,625 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:19,627 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,627 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:19,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:19,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:19,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:19,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d0ab5[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:19,633 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:19,633 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,643 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,643 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:19,646 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,650 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:19,650 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:19,650 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:19,660 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:19,660 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:19,660 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:19,661 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:19,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:19,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:19,676 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:19,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:19,676 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:19,676 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:19,676 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,676 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:19,683 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:19,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:19,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:19,685 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:19,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:19,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,712 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:19,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:19,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:19,712 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:19,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:19,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:19,714 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,714 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,714 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:19,714 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:19,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:19,721 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:19,721 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:19,821 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,900 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:19,900 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:19,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:19,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:19,910 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,910 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,930 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:19,931 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,933 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:19,933 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:19,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:19,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:19,950 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:19,950 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:19,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:19,958 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:19,958 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:19,959 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:19,959 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:19,959 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:54:20,065 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128edaa89252063482a8abc4c2e0d03437a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128edaa89252063482a8abc4c2e0d03437a 2023-11-03 13:54:20,125 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/cea3345b64cb4d75ae921e69cc968e09 2023-11-03 13:54:20,154 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/cea3345b64cb4d75ae921e69cc968e09 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09 2023-11-03 13:54:20,173 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:54:20,175 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 216ms, sequenceid=9, compaction requested=false 2023-11-03 13:54:20,176 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:20,176 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:20,176 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:20,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:20,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:20,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:20,180 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,181 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,181 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:20,182 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:20,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:20,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@365b0acf[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:20,201 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:20,201 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,203 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,203 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:20,204 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:20,204 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:20,204 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,204 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:20,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:20,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:20,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:20,218 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:20,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:20,242 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:20,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:20,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:20,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,243 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:20,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:20,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,255 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,258 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:20,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,271 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,271 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:20,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:20,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:20,272 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:20,272 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:20,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:20,373 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:20,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:20,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:20,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:20,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,419 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:20,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:20,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:20,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:20,423 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,423 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,427 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:20,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,429 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,430 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:20,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:20,430 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:20,431 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:20,431 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:20,432 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,433 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:20,433 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:20,434 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:20,434 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:20,434 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:20,434 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:20,435 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:20,444 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:54:20,647 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-03 13:54:20,648 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-03 13:54:21,023 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019c062b19954e45a09359c3250a9d41c7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c062b19954e45a09359c3250a9d41c7 2023-11-03 13:54:21,495 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/736a1b3c4eba4dadb3629e10faef9563 2023-11-03 13:54:21,521 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/736a1b3c4eba4dadb3629e10faef9563 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563 2023-11-03 13:54:21,544 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563, entries=1, sequenceid=13, filesize=5.0 K 2023-11-03 13:54:21,550 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 1115ms, sequenceid=13, compaction requested=true 2023-11-03 13:54:21,551 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:21,551 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:21,551 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:21,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:21,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:21,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:21,560 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,560 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:21,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:21,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:21,562 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,562 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:21,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:21,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:21,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32808cca[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:21,587 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:21,587 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,589 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,590 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:21,590 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:21,590 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:21,602 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,602 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:21,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:21,603 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:21,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:21,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:21,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:21,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:21,670 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:21,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:21,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:21,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,671 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:21,676 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,676 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,677 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:21,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:21,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:21,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,694 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,735 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:21,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:21,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,769 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:21,770 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:21,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:21,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:21,771 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:21,772 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:21,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:21,872 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:21,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:21,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:21,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:21,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,893 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:21,893 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:21,893 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:21,893 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:21,894 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,894 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,898 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:21,898 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:21,900 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:21,901 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:21,903 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:21,903 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:21,904 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:21,904 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:21,904 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:21,904 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:21,904 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:21,905 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:22,004 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b081f002a5bc4d99a0d66e47de25e416 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b081f002a5bc4d99a0d66e47de25e416 2023-11-03 13:54:22,451 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/ec6c1b169efb4ad9b66baa3c850ed040 2023-11-03 13:54:22,472 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/ec6c1b169efb4ad9b66baa3c850ed040 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040 2023-11-03 13:54:22,492 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040, entries=1, sequenceid=17, filesize=5.0 K 2023-11-03 13:54:22,493 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 589ms, sequenceid=17, compaction requested=true 2023-11-03 13:54:22,494 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:22,494 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:22,494 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:22,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:22,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:22,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:22,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,524 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,524 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:22,526 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:22,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:22,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:22,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56c43568[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:22,570 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:22,570 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,573 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,573 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,573 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:22,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,574 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:22,574 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:22,574 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:22,578 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,578 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:22,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:22,578 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:22,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:22,578 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:22,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:22,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:22,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:22,605 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:22,605 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:22,605 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:22,606 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,606 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:22,611 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:22,611 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,611 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:22,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:22,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:22,612 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:22,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,633 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,633 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,634 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:22,634 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:22,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:22,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,635 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:22,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:22,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:22,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,636 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,636 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:22,636 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:22,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:22,736 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:22,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:22,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:22,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:22,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,757 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:22,757 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:22,759 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:22,759 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:22,761 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,761 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,766 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,766 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:22,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:22,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,770 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:22,771 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:22,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,785 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,786 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:22,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:22,786 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:22,787 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:22,790 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:22,794 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:22,794 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:22,795 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:22,796 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:22,796 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:22,932 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228980550a21084496f91dd011817bbcbbd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228980550a21084496f91dd011817bbcbbd 2023-11-03 13:54:23,402 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/c7d164ab224c466585cdab3e00148d13 2023-11-03 13:54:23,423 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/c7d164ab224c466585cdab3e00148d13 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13 2023-11-03 13:54:23,452 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13, entries=1, sequenceid=21, filesize=5.0 K 2023-11-03 13:54:23,462 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 666ms, sequenceid=21, compaction requested=true 2023-11-03 13:54:23,463 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:23,463 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:23,463 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:23,465 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:23,471 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,471 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,472 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,473 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:23,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:23,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b01a5a7[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:23,477 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:23,477 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,495 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:23,495 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:23,495 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:23,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:23,501 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,501 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:23,501 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:23,501 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:23,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:23,513 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:23,513 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:23,513 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:23,513 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,513 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:23,517 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,517 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,517 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:23,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:23,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:23,519 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,524 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,531 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:23,531 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:23,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:23,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:23,534 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:23,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:23,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:23,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:23,537 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:23,537 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:23,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:23,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,638 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:23,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:23,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:23,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:23,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,660 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:23,660 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:23,661 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:23,661 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:23,661 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,662 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,663 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:23,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:23,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:23,664 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,664 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:23,664 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:23,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,665 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,666 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:23,666 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:23,666 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:23,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:23,668 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:23,668 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:23,668 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:23,668 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:23,668 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:23,763 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314b7f5cfee9274adc972265ff5dddcc32 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512314b7f5cfee9274adc972265ff5dddcc32 2023-11-03 13:54:24,195 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/555927ec1b3c491ba0e10ac934cd70fc 2023-11-03 13:54:24,214 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/555927ec1b3c491ba0e10ac934cd70fc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc 2023-11-03 13:54:24,226 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc, entries=1, sequenceid=25, filesize=5.0 K 2023-11-03 13:54:24,228 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 560ms, sequenceid=25, compaction requested=true 2023-11-03 13:54:24,229 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:24,229 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:24,229 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:24,229 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:24,229 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:24,233 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,233 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,233 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:24,234 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:24,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:24,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55e2dd7a[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:24,237 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:24,237 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:24,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:24,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:24,252 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:24,252 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:24,252 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:24,255 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,257 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:24,257 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:24,257 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:24,257 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:24,257 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:24,257 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,257 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:24,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:24,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:24,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:24,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:24,272 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:24,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:24,274 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,288 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:24,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:24,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:24,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:24,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:24,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:24,299 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:24,299 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:24,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:24,399 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:24,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:24,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:24,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:24,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,430 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:24,430 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:24,431 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:24,431 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:24,432 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,432 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,437 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,437 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:24,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,438 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,439 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,446 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:24,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,448 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:24,448 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:24,459 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:24,462 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:24,462 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:24,462 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:24,462 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:24,463 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:24,540 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101787be8844ff542e7a5769b35e91a00f7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101787be8844ff542e7a5769b35e91a00f7 2023-11-03 13:54:24,557 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/202fe0c2a6b34281ba7b3f04a301fbda 2023-11-03 13:54:24,580 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/202fe0c2a6b34281ba7b3f04a301fbda as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda 2023-11-03 13:54:24,598 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda, entries=1, sequenceid=29, filesize=5.0 K 2023-11-03 13:54:24,599 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 136ms, sequenceid=29, compaction requested=true 2023-11-03 13:54:24,599 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:24,600 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:24,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:24,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:24,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:24,601 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:24,606 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:24,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:24,607 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,607 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:24,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:24,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63b2fdd0[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:24,610 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:24,611 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,618 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:24,620 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:24,620 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:24,621 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:24,624 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:24,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:24,625 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:24,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:24,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:24,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,625 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:24,646 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:24,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:24,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:24,656 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:24,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:24,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:24,685 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:24,686 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:24,685 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:24,686 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:24,686 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,690 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:24,691 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:24,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:24,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:24,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:24,791 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:24,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:24,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:24,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:24,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,809 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:24,809 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:24,811 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:24,811 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:24,812 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,812 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,816 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,817 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:24,817 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:24,818 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:24,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,829 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:24,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:24,834 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:24,834 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:24,835 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:24,838 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:24,838 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:24,838 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:24,838 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:24,838 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:24,951 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d83358ec8a164831aa4a18250d8892c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103d83358ec8a164831aa4a18250d8892c0 2023-11-03 13:54:25,015 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/1332d72035c849b4906e13d1535d7ea8 2023-11-03 13:54:25,033 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/1332d72035c849b4906e13d1535d7ea8 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8 2023-11-03 13:54:25,048 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8, entries=1, sequenceid=33, filesize=5.0 K 2023-11-03 13:54:25,050 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 211ms, sequenceid=33, compaction requested=true 2023-11-03 13:54:25,050 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:25,050 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:25,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:25,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:25,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:25,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,054 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:25,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,055 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:25,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:25,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:25,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:25,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@142aebbb[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:25,057 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:25,058 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,066 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,067 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,067 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:25,067 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:25,067 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:25,067 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:25,077 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:25,077 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:25,077 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:25,082 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:25,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:25,091 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:25,091 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:25,091 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:25,091 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,091 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:25,094 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,094 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,094 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:25,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:25,095 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:25,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,104 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,109 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:25,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:25,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:25,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:25,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:25,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:25,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:25,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:25,112 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:25,112 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:25,212 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:25,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:25,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:25,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:25,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,237 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:25,237 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:25,238 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:25,238 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:25,240 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,240 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,242 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:25,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:25,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,250 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:25,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:25,254 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:25,254 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:25,258 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:25,258 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:25,259 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:25,793 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079430d2182f734802a285b2f9679cfa29 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509079430d2182f734802a285b2f9679cfa29 2023-11-03 13:54:25,860 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/a8d4d6d0443a48d0bce197d69c22ac20 2023-11-03 13:54:25,882 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/a8d4d6d0443a48d0bce197d69c22ac20 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20 2023-11-03 13:54:25,907 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20, entries=1, sequenceid=37, filesize=5.0 K 2023-11-03 13:54:25,908 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 649ms, sequenceid=37, compaction requested=true 2023-11-03 13:54:25,908 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:25,908 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:25,909 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:25,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:25,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:25,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:25,926 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:25,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:25,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,934 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,934 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:25,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:25,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22304804[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:25,935 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:25,935 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:25,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,946 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:25,946 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:25,946 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:25,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:25,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:25,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:25,964 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:25,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:25,990 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:25,990 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:25,990 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:25,990 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:25,990 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:26,001 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,002 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:26,002 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:26,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:26,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:26,008 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,042 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,067 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:26,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:26,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:26,068 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:26,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:26,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:26,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:26,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:26,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:26,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,071 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,071 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,071 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,075 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:26,075 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:26,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-03 13:54:26,175 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:26,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:26,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,224 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:26,224 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:26,229 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-03 13:54:26,229 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-03 13:54:26,233 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,233 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,236 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,239 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:26,239 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:26,242 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:26,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,255 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-03 13:54:26,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:26,255 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-03 13:54:26,256 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:26,257 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-03 13:54:26,270 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:26,270 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:26,270 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:26,270 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. started... 2023-11-03 13:54:26,271 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38279015a373f34c66be1e5fe643de64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:26,812 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112011aa26f794164a57bf25fe6c4f54c775 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112011aa26f794164a57bf25fe6c4f54c775 2023-11-03 13:54:27,271 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/022d1c2267be4524883d0d036f3987a4 2023-11-03 13:54:27,295 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/022d1c2267be4524883d0d036f3987a4 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4 2023-11-03 13:54:27,336 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4, entries=1, sequenceid=41, filesize=5.0 K 2023-11-03 13:54:27,341 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38279015a373f34c66be1e5fe643de64 in 1070ms, sequenceid=41, compaction requested=true 2023-11-03 13:54:27,341 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:27,341 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:27,345 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:27,348 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:27,348 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,348 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-03 13:54:27,348 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-03 13:54:27,356 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,362 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:27,365 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,365 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:27,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:27,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-03 13:54:27,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61fa5835[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:27,408 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-03 13:54:27,408 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,414 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-03 13:54:27,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-03 13:54:27,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:27,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:27,427 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:27,427 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-03 13:54:27,427 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:27,427 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-03 13:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:27,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-03 13:54:27,463 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-03 13:54:27,463 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:27,463 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:27,463 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,463 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:27,477 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,477 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,477 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:27,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:27,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:27,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:27,492 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,506 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,538 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:27,538 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:27,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:27,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,539 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:27,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:27,543 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:27,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-03 13:54:27,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:27,550 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:27,550 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:27,654 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:27,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:27,678 DEBUG [Listener at localhost/39963] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-03 13:54:27,685 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-03 13:54:27,690 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:27,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:27,733 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:27,738 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020267738 2023-11-03 13:54:27,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:27,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:54:27,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-03 13:54:27,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:27,772 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2b4006 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:27,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3be8f374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:27,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:28,823 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103972015c18afe462da233fd41835e2aab to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103972015c18afe462da233fd41835e2aab 2023-11-03 13:54:28,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:28,849 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:28,851 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:28,872 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:28,876 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:28,929 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/935638c0e0db4aebbdbd1a31447437fb first=Optional[r3] last=Optional[r6] 2023-11-03 13:54:28,947 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/935638c0e0db4aebbdbd1a31447437fb}] 2023-11-03 13:54:28,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/935638c0e0db4aebbdbd1a31447437fb for inclusion in 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:29,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-03 13:54:29,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:29,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:29,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/935638c0e0db4aebbdbd1a31447437fb to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lrkpvlc2ugd1182t2b3ej1e03opgt3r1besk7g9iqkr2n61od17edsq9rkrasulo/family1/935638c0e0db4aebbdbd1a31447437fb 2023-11-03 13:54:29,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lrkpvlc2ugd1182t2b3ej1e03opgt3r1besk7g9iqkr2n61od17edsq9rkrasulo/family1/935638c0e0db4aebbdbd1a31447437fb as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_ 2023-11-03 13:54:29,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lrkpvlc2ugd1182t2b3ej1e03opgt3r1besk7g9iqkr2n61od17edsq9rkrasulo/family1/935638c0e0db4aebbdbd1a31447437fb into 38279015a373f34c66be1e5fe643de64/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_ - updating store file list. 2023-11-03 13:54:29,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_ into 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:29,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lrkpvlc2ugd1182t2b3ej1e03opgt3r1besk7g9iqkr2n61od17edsq9rkrasulo/family1/935638c0e0db4aebbdbd1a31447437fb into 38279015a373f34c66be1e5fe643de64/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_) 2023-11-03 13:54:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lrkpvlc2ugd1182t2b3ej1e03opgt3r1besk7g9iqkr2n61od17edsq9rkrasulo/family1/935638c0e0db4aebbdbd1a31447437fb 2023-11-03 13:54:29,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:54:29,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:54:29,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 38279015a373f34c66be1e5fe643de64/family1 is initiating minor compaction 2023-11-03 13:54:29,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@61cf564a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:29,063 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 38279015a373f34c66be1e5fe643de64/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:29,067 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp, totalSize=50.2 K 2023-11-03 13:54:29,068 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting cea3345b64cb4d75ae921e69cc968e09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:54:29,070 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 736a1b3c4eba4dadb3629e10faef9563, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:54:29,071 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting ec6c1b169efb4ad9b66baa3c850ed040, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:54:29,071 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting c7d164ab224c466585cdab3e00148d13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 555927ec1b3c491ba0e10ac934cd70fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 202fe0c2a6b34281ba7b3f04a301fbda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 1332d72035c849b4906e13d1535d7ea8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting a8d4d6d0443a48d0bce197d69c22ac20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 022d1c2267be4524883d0d036f3987a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:54:29,072 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:54:29,097 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:29,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:29,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228980550a21084496f91dd011817bbcbbd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228980550a21084496f91dd011817bbcbbd 2023-11-03 13:54:29,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512314b7f5cfee9274adc972265ff5dddcc32 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512314b7f5cfee9274adc972265ff5dddcc32 2023-11-03 13:54:29,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101787be8844ff542e7a5769b35e91a00f7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101787be8844ff542e7a5769b35e91a00f7 2023-11-03 13:54:29,131 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103d83358ec8a164831aa4a18250d8892c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103d83358ec8a164831aa4a18250d8892c0 2023-11-03 13:54:29,131 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-03 13:54:29,131 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-03 13:54:29,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,231 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38279015a373f34c66be1e5fe643de64#family1#compaction#10 average throughput is 0.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:29,416 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058dc7a5542bb34032ae58388e807010d9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512058dc7a5542bb34032ae58388e807010d9 2023-11-03 13:54:29,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:29,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/551f49fecd6a44eda9d9227e806fe9dc first=Optional[r00] last=Optional[r2] 2023-11-03 13:54:29,482 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/551f49fecd6a44eda9d9227e806fe9dc}] 2023-11-03 13:54:29,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/551f49fecd6a44eda9d9227e806fe9dc for inclusion in 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:29,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-03 13:54:29,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:29,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:29,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/551f49fecd6a44eda9d9227e806fe9dc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sl7do5omr3fqljfkto5e1g41kjbs2b40e3acogice9k9n7ko7s0tt859mp809cbs/family1/551f49fecd6a44eda9d9227e806fe9dc 2023-11-03 13:54:29,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sl7do5omr3fqljfkto5e1g41kjbs2b40e3acogice9k9n7ko7s0tt859mp809cbs/family1/551f49fecd6a44eda9d9227e806fe9dc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ 2023-11-03 13:54:29,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sl7do5omr3fqljfkto5e1g41kjbs2b40e3acogice9k9n7ko7s0tt859mp809cbs/family1/551f49fecd6a44eda9d9227e806fe9dc into 38279015a373f34c66be1e5fe643de64/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ - updating store file list. 2023-11-03 13:54:29,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ into 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:29,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sl7do5omr3fqljfkto5e1g41kjbs2b40e3acogice9k9n7ko7s0tt859mp809cbs/family1/551f49fecd6a44eda9d9227e806fe9dc into 38279015a373f34c66be1e5fe643de64/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_) 2023-11-03 13:54:29,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sl7do5omr3fqljfkto5e1g41kjbs2b40e3acogice9k9n7ko7s0tt859mp809cbs/family1/551f49fecd6a44eda9d9227e806fe9dc 2023-11-03 13:54:29,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:29,541 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:29,543 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d8152f32f4b340759811beb1dbf4a075 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d8152f32f4b340759811beb1dbf4a075 2023-11-03 13:54:29,547 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c062b19954e45a09359c3250a9d41c7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c062b19954e45a09359c3250a9d41c7 2023-11-03 13:54:29,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b081f002a5bc4d99a0d66e47de25e416 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b081f002a5bc4d99a0d66e47de25e416 2023-11-03 13:54:29,551 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-03 13:54:29,551 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-03 13:54:29,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:29,553 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:29,553 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:29,555 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:29,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.8580 sec 2023-11-03 13:54:29,744 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:54:29,745 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2b4006 to 127.0.0.1:53668 2023-11-03 13:54:29,745 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:54:29,823 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/7861c5edda194442b633cb76d032a440 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440 2023-11-03 13:54:29,855 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 38279015a373f34c66be1e5fe643de64/family1 of 38279015a373f34c66be1e5fe643de64 into 7861c5edda194442b633cb76d032a440(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:54:29,855 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:29,858 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699019669057; duration=0sec 2023-11-03 13:54:29,860 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:29,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_] to archive 2023-11-03 13:54:29,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:29,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/cea3345b64cb4d75ae921e69cc968e09 2023-11-03 13:54:29,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/736a1b3c4eba4dadb3629e10faef9563 2023-11-03 13:54:29,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/ec6c1b169efb4ad9b66baa3c850ed040 2023-11-03 13:54:29,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/c7d164ab224c466585cdab3e00148d13 2023-11-03 13:54:29,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/555927ec1b3c491ba0e10ac934cd70fc 2023-11-03 13:54:29,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/202fe0c2a6b34281ba7b3f04a301fbda 2023-11-03 13:54:29,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-03 13:54:29,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/1332d72035c849b4906e13d1535d7ea8 2023-11-03 13:54:29,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/a8d4d6d0443a48d0bce197d69c22ac20 2023-11-03 13:54:29,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/022d1c2267be4524883d0d036f3987a4 2023-11-03 13:54:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:30,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/d20d209d08a74fb585c7dca3b66c49dd_SeqId_44_ 2023-11-03 13:54:30,054 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-03 13:54:30,056 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:30,056 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-03 13:54:30,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-03 13:54:30,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, REOPEN/MOVE}] 2023-11-03 13:54:30,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, REOPEN/MOVE 2023-11-03 13:54:30,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:30,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019670099"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019670099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019670099"}]},"ts":"1699019670099"} 2023-11-03 13:54:30,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:30,268 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:30,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 38279015a373f34c66be1e5fe643de64, disabling compactions & flushes 2023-11-03 13:54:30,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. after waiting 0 ms 2023-11-03 13:54:30,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-03 13:54:30,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:30,328 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 38279015a373f34c66be1e5fe643de64 to self. 2023-11-03 13:54:30,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,343 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=CLOSED 2023-11-03 13:54:30,344 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019670343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019670343"}]},"ts":"1699019670343"} 2023-11-03 13:54:30,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-03 13:54:30,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288 in 244 msec 2023-11-03 13:54:30,357 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=true 2023-11-03 13:54:30,508 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:30,508 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019670508"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019670508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019670508"}]},"ts":"1699019670508"} 2023-11-03 13:54:30,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:30,667 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:30,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38279015a373f34c66be1e5fe643de64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:30,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,678 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,679 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:30,680 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:30,680 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38279015a373f34c66be1e5fe643de64 columnFamilyName family1 2023-11-03 13:54:30,702 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723 2023-11-03 13:54:30,713 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ 2023-11-03 13:54:30,731 DEBUG [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440 2023-11-03 13:54:30,732 INFO [StoreOpener-38279015a373f34c66be1e5fe643de64-1] regionserver.HStore(310): Store=38279015a373f34c66be1e5fe643de64/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:30,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:54:30,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 38279015a373f34c66be1e5fe643de64; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62682612, jitterRate=-0.06595629453659058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:30,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:30,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., pid=17, masterSystemTime=1699019670667 2023-11-03 13:54:30,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:30,751 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:54:30,755 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:54:30,756 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1912): 38279015a373f34c66be1e5fe643de64/family1 is initiating minor compaction (all files) 2023-11-03 13:54:30,756 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 38279015a373f34c66be1e5fe643de64/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,756 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp, totalSize=358.6 K 2023-11-03 13:54:30,757 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 030586a55dc841dabba94fb8b884f723, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:54:30,757 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 7861c5edda194442b633cb76d032a440, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:54:30,758 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 305e873cf2714b04995a33f9c957256f_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878817029 2023-11-03 13:54:30,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:54:30,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38279015a373f34c66be1e5fe643de64, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:30,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699019670761"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019670761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019670761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019670761"}]},"ts":"1699019670761"} 2023-11-03 13:54:30,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-03 13:54:30,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 38279015a373f34c66be1e5fe643de64, server=jenkins-hbase20.apache.org,46707,1699019650288 in 253 msec 2023-11-03 13:54:30,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-03 13:54:30,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=38279015a373f34c66be1e5fe643de64, REOPEN/MOVE in 687 msec 2023-11-03 13:54:30,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-03 13:54:30,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 729 msec 2023-11-03 13:54:30,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 806 msec 2023-11-03 13:54:30,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-03 13:54:30,840 INFO [Listener at localhost/39963] compactions.TestMobCompactor(278): alter status finished 2023-11-03 13:54:30,842 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-03 13:54:30,846 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:30,866 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:30,868 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020270868 2023-11-03 13:54:30,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:30,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:54:30,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-03 13:54:30,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:30,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x6b2cd55c to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:30,937 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38279015a373f34c66be1e5fe643de64#family1#compaction#11 average throughput is 1.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:30,980 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@251ce9d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:30,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:30,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:30,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:30,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:30,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:31,164 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/.tmp/family1/868324c6084245368f55cbb698daf296 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/868324c6084245368f55cbb698daf296 2023-11-03 13:54:31,180 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 38279015a373f34c66be1e5fe643de64/family1 of 38279015a373f34c66be1e5fe643de64 into 868324c6084245368f55cbb698daf296(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:54:31,181 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:31,181 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., storeName=38279015a373f34c66be1e5fe643de64/family1, priority=13, startTime=1699019670749; duration=0sec 2023-11-03 13:54:31,181 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:31,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_] to archive 2023-11-03 13:54:31,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:31,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/030586a55dc841dabba94fb8b884f723 2023-11-03 13:54:31,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/7861c5edda194442b633cb76d032a440 2023-11-03 13:54:31,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/305e873cf2714b04995a33f9c957256f_SeqId_46_ 2023-11-03 13:54:31,548 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112827e872d6d0f64f97a4b904ee9f0e428a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112827e872d6d0f64f97a4b904ee9f0e428a 2023-11-03 13:54:31,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:31,584 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:31,585 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:31,602 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:31,605 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:31,632 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5d99052bedd84d1a84e54eaf808d486a first=Optional[r05] last=Optional[r8] 2023-11-03 13:54:31,633 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=50 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5d99052bedd84d1a84e54eaf808d486a}] 2023-11-03 13:54:31,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5d99052bedd84d1a84e54eaf808d486a for inclusion in 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-03 13:54:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:54:31,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5d99052bedd84d1a84e54eaf808d486a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jajfm9lh7cpjb70cg986ckq3l0eg3k4atuelrs37s6mpq927m54vhvaa19rdb9c1/family1/5d99052bedd84d1a84e54eaf808d486a 2023-11-03 13:54:31,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jajfm9lh7cpjb70cg986ckq3l0eg3k4atuelrs37s6mpq927m54vhvaa19rdb9c1/family1/5d99052bedd84d1a84e54eaf808d486a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/2a25f061813e457a8ecd79f00ab57168_SeqId_53_ 2023-11-03 13:54:31,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jajfm9lh7cpjb70cg986ckq3l0eg3k4atuelrs37s6mpq927m54vhvaa19rdb9c1/family1/5d99052bedd84d1a84e54eaf808d486a into 38279015a373f34c66be1e5fe643de64/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/2a25f061813e457a8ecd79f00ab57168_SeqId_53_ - updating store file list. 2023-11-03 13:54:31,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/2a25f061813e457a8ecd79f00ab57168_SeqId_53_ into 38279015a373f34c66be1e5fe643de64/family1 2023-11-03 13:54:31,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jajfm9lh7cpjb70cg986ckq3l0eg3k4atuelrs37s6mpq927m54vhvaa19rdb9c1/family1/5d99052bedd84d1a84e54eaf808d486a into 38279015a373f34c66be1e5fe643de64/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/family1/2a25f061813e457a8ecd79f00ab57168_SeqId_53_) 2023-11-03 13:54:31,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jajfm9lh7cpjb70cg986ckq3l0eg3k4atuelrs37s6mpq927m54vhvaa19rdb9c1/family1/5d99052bedd84d1a84e54eaf808d486a 2023-11-03 13:54:31,735 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:31,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:31,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112011aa26f794164a57bf25fe6c4f54c775 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112011aa26f794164a57bf25fe6c4f54c775 2023-11-03 13:54:31,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128edaa89252063482a8abc4c2e0d03437a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128edaa89252063482a8abc4c2e0d03437a 2023-11-03 13:54:31,747 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-03 13:54:31,747 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-03 13:54:31,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:31,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:31,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-03 13:54:31,749 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-03 13:54:31,749 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:31,751 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-03 13:54:31,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 908 msec 2023-11-03 13:54:32,108 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=242 (was 214) Potentially hanging thread: hconnection-0x2d0b6d74-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d0b6d74-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d0b6d74-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_327162516_17 at /127.0.0.1:34232 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x6b2cd55c-SendThread(127.0.0.1:53668) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34440 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34222 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34192 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x6b2cd55c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1231824781.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34264 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34316 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34270 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34300 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34236 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34318 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x6b2cd55c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:46707-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34434 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34344 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34214 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1741 (was 1780), ProcessCount=192 (was 194), AvailableMemoryMB=481 (was 263) - AvailableMemoryMB LEAK? - 2023-11-03 13:54:32,140 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=242, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=1741, ProcessCount=191, AvailableMemoryMB=479 2023-11-03 13:54:32,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-03 13:54:32,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:32,149 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:32,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-03 13:54:32,150 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:32,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-03 13:54:32,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:32,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc empty. 2023-11-03 13:54:32,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:32,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-03 13:54:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-03 13:54:32,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-03 13:54:32,608 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:32,611 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31de55707a073f93015ed03c91cb49dc, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:32,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:32,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 31de55707a073f93015ed03c91cb49dc, disabling compactions & flushes 2023-11-03 13:54:32,652 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:32,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:32,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. after waiting 0 ms 2023-11-03 13:54:32,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:32,652 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:32,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:32,676 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:32,677 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019672677"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019672677"}]},"ts":"1699019672677"} 2023-11-03 13:54:32,683 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:54:32,687 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:32,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019672688"}]},"ts":"1699019672688"} 2023-11-03 13:54:32,690 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-03 13:54:32,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=31de55707a073f93015ed03c91cb49dc, ASSIGN}] 2023-11-03 13:54:32,700 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=31de55707a073f93015ed03c91cb49dc, ASSIGN 2023-11-03 13:54:32,702 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=31de55707a073f93015ed03c91cb49dc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:32,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-03 13:54:32,853 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=31de55707a073f93015ed03c91cb49dc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:32,854 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019672853"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019672853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019672853"}]},"ts":"1699019672853"} 2023-11-03 13:54:32,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 31de55707a073f93015ed03c91cb49dc, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:33,030 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31de55707a073f93015ed03c91cb49dc, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:33,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,044 INFO [StoreOpener-31de55707a073f93015ed03c91cb49dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,046 DEBUG [StoreOpener-31de55707a073f93015ed03c91cb49dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:33,046 DEBUG [StoreOpener-31de55707a073f93015ed03c91cb49dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:33,046 INFO [StoreOpener-31de55707a073f93015ed03c91cb49dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31de55707a073f93015ed03c91cb49dc columnFamilyName family1 2023-11-03 13:54:33,049 INFO [StoreOpener-31de55707a073f93015ed03c91cb49dc-1] regionserver.HStore(310): Store=31de55707a073f93015ed03c91cb49dc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:33,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:54:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:33,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 31de55707a073f93015ed03c91cb49dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65252776, jitterRate=-0.02765786647796631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:33,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:33,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc., pid=21, masterSystemTime=1699019673030 2023-11-03 13:54:33,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,077 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=31de55707a073f93015ed03c91cb49dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,077 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019673077"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019673077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019673077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019673077"}]},"ts":"1699019673077"} 2023-11-03 13:54:33,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-03 13:54:33,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 31de55707a073f93015ed03c91cb49dc, server=jenkins-hbase20.apache.org,46707,1699019650288 in 214 msec 2023-11-03 13:54:33,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-03 13:54:33,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=31de55707a073f93015ed03c91cb49dc, ASSIGN in 390 msec 2023-11-03 13:54:33,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:54:33,100 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019673099"}]},"ts":"1699019673099"} 2023-11-03 13:54:33,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-03 13:54:33,106 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:54:33,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 961 msec 2023-11-03 13:54:33,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-03 13:54:33,260 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-03 13:54:33,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:33,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,420 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:33,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:33,421 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:33,421 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:33,424 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,424 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,428 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:33,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:33,429 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,429 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,429 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,435 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:33,435 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:33,436 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:33,438 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:33,438 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:33,442 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,442 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:33,444 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:54:33,550 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113030dc026ff45c4236ab7da59f62ca9ce3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dc026ff45c4236ab7da59f62ca9ce3 2023-11-03 13:54:33,565 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/67013c3f31b64813ac4f76927280cb24 2023-11-03 13:54:33,575 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/67013c3f31b64813ac4f76927280cb24 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/67013c3f31b64813ac4f76927280cb24 2023-11-03 13:54:33,591 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/67013c3f31b64813ac4f76927280cb24, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-03 13:54:33,603 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 159ms, sequenceid=5, compaction requested=false 2023-11-03 13:54:33,603 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:33,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:33,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:33,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:33,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:33,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:33,611 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,611 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,611 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:33,614 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:33,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:33,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155275a7[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:33,621 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:33,621 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,630 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,630 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:33,630 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:33,630 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:33,644 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,644 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:33,654 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:33,655 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:33,655 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:33,662 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:33,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:33,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:33,689 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:33,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:33,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:33,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,689 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:33,695 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,695 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:33,695 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:33,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,697 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,700 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,715 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:33,715 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:33,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,716 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,716 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:33,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:33,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:33,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:33,717 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:33,717 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:33,817 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:33,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:33,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,860 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:33,860 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:33,863 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:33,863 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:33,864 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,864 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,875 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:33,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:33,875 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,876 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:33,876 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:33,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:33,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:33,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:33,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:33,899 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:33,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:33,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:33,911 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:33,912 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:33,912 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:54:34,011 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128be2ae8b7fafd4979b20175745cfd8457 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128be2ae8b7fafd4979b20175745cfd8457 2023-11-03 13:54:34,471 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/aec1a43da9e8491d83bd0c369e28907f 2023-11-03 13:54:34,486 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/aec1a43da9e8491d83bd0c369e28907f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f 2023-11-03 13:54:34,525 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:54:34,527 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 615ms, sequenceid=9, compaction requested=false 2023-11-03 13:54:34,527 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:34,527 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:34,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:34,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:34,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:34,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:34,544 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:34,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:34,545 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:34,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:34,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:34,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:34,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e62385[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:34,567 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:34,567 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,570 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,570 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:34,570 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:34,570 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:34,574 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,575 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:34,585 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:34,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:34,589 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:34,589 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:34,589 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:34,589 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,590 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:34,594 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,594 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,595 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:34,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,598 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,602 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:34,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,631 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,631 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:34,631 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:34,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,631 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:34,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:34,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:34,632 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:34,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:34,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:34,635 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:34,635 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:34,735 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:34,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:34,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:34,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:34,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,770 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:34,770 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:34,777 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:34,777 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:34,779 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,779 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,781 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:34,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,782 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:34,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,784 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:34,784 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:34,790 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:34,790 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:34,791 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:34,792 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:34,804 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:34,804 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:34,804 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:34,804 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:34,804 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:35,292 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120161ae867bf40b44198cbc88acf460ff5a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120161ae867bf40b44198cbc88acf460ff5a 2023-11-03 13:54:35,722 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/112b14d69de24d01bff5b2c8b7344a95 2023-11-03 13:54:35,758 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/112b14d69de24d01bff5b2c8b7344a95 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95 2023-11-03 13:54:35,777 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95, entries=1, sequenceid=13, filesize=4.9 K 2023-11-03 13:54:35,785 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 981ms, sequenceid=13, compaction requested=true 2023-11-03 13:54:35,785 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:35,785 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:35,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:35,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,799 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,799 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,799 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:35,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:35,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76b63135[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:35,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:35,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,806 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,806 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:35,810 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:35,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:35,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:35,820 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:35,820 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:35,820 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:35,821 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:35,839 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:35,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:35,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:35,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,839 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:35,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:35,842 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,842 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:35,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:35,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,851 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,859 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:35,859 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:35,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:35,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:35,862 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:35,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:35,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:35,862 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:35,862 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:35,921 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:54:35,963 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:35,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:35,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:36,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:36,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,026 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:36,027 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:36,027 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:36,027 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:36,031 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,031 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,033 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:36,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:36,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,036 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:36,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:36,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,037 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:36,037 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:36,045 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:36,059 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:36,059 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:36,059 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:36,059 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:36,059 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:36,140 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ae1a707b71434c49918eeeecb44e68a4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae1a707b71434c49918eeeecb44e68a4 2023-11-03 13:54:36,565 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/5bfb286a484b4aebaa1b193ba242029a 2023-11-03 13:54:36,572 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/5bfb286a484b4aebaa1b193ba242029a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a 2023-11-03 13:54:36,578 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a, entries=1, sequenceid=17, filesize=4.9 K 2023-11-03 13:54:36,580 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 521ms, sequenceid=17, compaction requested=true 2023-11-03 13:54:36,580 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:36,580 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:36,580 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:36,580 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:36,580 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,580 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:36,580 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:36,581 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:36,583 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,583 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:36,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:36,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:36,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@453ef426[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:36,590 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:36,590 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,595 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:36,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:36,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:36,598 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,598 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:36,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:36,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:36,603 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:36,603 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:36,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:36,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:36,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:36,613 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:36,613 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:36,613 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:36,613 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,613 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:36,617 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,617 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:36,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,617 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:36,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:36,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:36,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:36,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,619 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,620 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:36,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:36,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:36,624 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:36,624 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:36,625 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:36,625 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:36,726 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:36,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:36,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:36,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:36,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,735 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:36,735 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:36,736 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:36,736 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:36,736 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,736 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,737 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:36,737 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:36,738 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:36,738 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:36,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:36,739 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:36,739 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:36,739 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:36,740 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:36,740 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:36,740 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:36,740 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:36,740 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:37,155 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c446d307c0854baba6352176db78d156 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c446d307c0854baba6352176db78d156 2023-11-03 13:54:37,565 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/c9e86d54cad244a29e42ba7c670730b6 2023-11-03 13:54:37,577 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/c9e86d54cad244a29e42ba7c670730b6 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6 2023-11-03 13:54:37,589 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6, entries=1, sequenceid=21, filesize=4.9 K 2023-11-03 13:54:37,590 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 850ms, sequenceid=21, compaction requested=true 2023-11-03 13:54:37,590 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:37,590 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:37,591 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:37,591 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:37,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:37,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:37,596 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:37,596 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:37,597 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,597 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:37,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:37,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:37,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43c75e6b[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:37,599 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:37,599 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,607 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,608 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:37,608 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:37,628 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:37,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:37,645 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:37,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:37,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:37,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,645 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:37,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:37,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:37,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:37,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:37,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:37,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:37,649 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:37,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,654 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:37,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,658 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:37,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:54:37,658 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:37,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:37,658 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:37,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:37,660 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:37,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:37,661 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:37,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:37,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:37,761 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:37,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:37,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:37,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:37,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,771 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:37,771 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:37,772 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:37,772 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:37,772 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,772 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,773 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:37,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:37,774 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:37,774 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:37,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:37,775 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:37,775 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:37,776 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:37,778 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:37,778 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:37,778 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:37,778 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:37,778 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:38,203 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314bb15de7c6a942e9b35631d816ad3976 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314bb15de7c6a942e9b35631d816ad3976 2023-11-03 13:54:38,611 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/b73d804a9ae2472e9ad2e6f382aa1520 2023-11-03 13:54:38,625 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/b73d804a9ae2472e9ad2e6f382aa1520 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520 2023-11-03 13:54:38,640 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520, entries=1, sequenceid=25, filesize=4.9 K 2023-11-03 13:54:38,642 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 864ms, sequenceid=25, compaction requested=true 2023-11-03 13:54:38,642 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:38,642 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:38,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:38,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:38,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:38,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:38,649 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:38,650 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:38,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:38,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@245ab79d[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:38,666 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:38,666 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,678 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,681 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:38,681 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:38,681 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:38,682 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,682 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:38,699 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:38,700 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:38,700 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:38,702 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:38,708 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:38,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:38,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:38,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,708 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:38,710 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:38,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,711 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:38,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:38,711 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,716 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:38,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,725 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:38,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:54:38,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:38,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:38,725 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:38,726 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:38,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:38,726 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:38,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:38,726 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:38,826 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:38,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:38,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:38,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:38,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,836 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:38,836 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:38,836 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:38,836 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:38,837 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,837 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,838 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:38,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:38,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:38,839 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,842 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:38,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:38,844 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:38,844 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:38,844 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:38,844 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:39,281 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010191566ee0eefd4523a1b113203110cd0d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010191566ee0eefd4523a1b113203110cd0d 2023-11-03 13:54:39,712 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/d80612b0dfa0469593b11892541b4520 2023-11-03 13:54:39,739 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/d80612b0dfa0469593b11892541b4520 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520 2023-11-03 13:54:39,789 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520, entries=1, sequenceid=29, filesize=4.9 K 2023-11-03 13:54:39,794 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 950ms, sequenceid=29, compaction requested=true 2023-11-03 13:54:39,794 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:39,794 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:39,794 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:39,795 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:39,795 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,795 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:39,795 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:39,799 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,800 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,800 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:39,800 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:39,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:39,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:39,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63a205ba[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:39,816 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:39,816 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,818 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,822 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,822 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:39,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,826 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:39,826 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:39,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:39,834 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:39,834 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:39,834 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:39,838 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:39,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:39,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:39,847 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:39,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:39,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:39,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,848 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:39,854 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,854 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:39,854 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:39,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,860 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:39,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:39,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,872 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,878 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:39,878 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:39,879 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:39,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,879 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:39,882 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:39,882 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:39,983 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:39,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:39,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:40,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:40,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,026 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:40,027 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:40,031 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:40,031 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:40,032 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,032 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,033 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:40,033 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:40,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,041 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:40,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,042 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:40,042 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:40,042 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:40,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:40,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:40,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:40,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:40,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:40,167 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103933ac6b474514d8582bcd4a6221a534b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103933ac6b474514d8582bcd4a6221a534b 2023-11-03 13:54:40,201 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/968eda63d5e3463990ccc4eb6cce923e 2023-11-03 13:54:40,227 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/968eda63d5e3463990ccc4eb6cce923e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e 2023-11-03 13:54:40,247 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e, entries=1, sequenceid=33, filesize=4.9 K 2023-11-03 13:54:40,258 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 204ms, sequenceid=33, compaction requested=true 2023-11-03 13:54:40,259 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:40,259 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:40,260 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:40,260 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:40,260 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,260 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:40,260 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:40,263 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:40,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:40,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510f522c[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:40,278 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:40,278 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,279 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:40,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:40,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:40,279 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,279 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:40,280 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,281 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:40,281 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:40,281 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:40,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:40,299 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:40,299 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:40,299 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:40,299 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,299 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:40,305 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,306 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:40,305 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:40,311 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,312 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,317 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,317 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,317 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,317 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,317 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:40,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:40,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:40,317 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,318 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:40,318 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,318 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,318 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:40,322 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:40,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:40,419 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:40,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:40,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:40,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:40,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,438 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:40,438 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:40,439 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:40,439 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:40,439 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,439 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,440 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:40,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:40,441 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,441 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,443 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:40,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,443 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:40,443 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:40,444 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:40,446 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:40,446 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:40,446 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:40,446 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:40,447 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:40,923 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c22b2e5d20a44ea4aaa06ff053835e26 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907c22b2e5d20a44ea4aaa06ff053835e26 2023-11-03 13:54:40,931 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/557bddf680014598a327c510e360da03 2023-11-03 13:54:40,943 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/557bddf680014598a327c510e360da03 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03 2023-11-03 13:54:40,950 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03, entries=1, sequenceid=37, filesize=4.9 K 2023-11-03 13:54:40,951 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 504ms, sequenceid=37, compaction requested=true 2023-11-03 13:54:40,951 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:40,951 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:40,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:40,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:40,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:40,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:40,953 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,953 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,953 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,953 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:40,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28c26a60[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:40,955 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:40,955 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,956 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:40,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:40,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:40,956 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,956 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:40,957 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,957 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,957 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:40,958 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:40,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:40,961 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:40,961 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:40,961 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:40,961 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,961 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:40,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:40,963 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,965 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:40,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:40,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:40,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:54:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:40,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:40,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:40,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:41,069 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:41,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:41,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:41,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:41,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,078 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:41,078 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:41,079 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:54:41,079 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:41,087 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,087 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,091 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,091 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:41,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:54:41,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,102 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:54:41,102 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:41,104 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:54:41,104 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:41,104 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:41,105 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:41,105 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. started... 2023-11-03 13:54:41,105 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 31de55707a073f93015ed03c91cb49dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:41,526 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120025706c68a7444bbbec7958a10a7beec to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120025706c68a7444bbbec7958a10a7beec 2023-11-03 13:54:41,933 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/31d4b0bda86c4a43a83c87a0bd1cc012 2023-11-03 13:54:41,953 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/31d4b0bda86c4a43a83c87a0bd1cc012 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012 2023-11-03 13:54:41,962 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012, entries=1, sequenceid=41, filesize=4.9 K 2023-11-03 13:54:41,963 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31de55707a073f93015ed03c91cb49dc in 858ms, sequenceid=41, compaction requested=true 2023-11-03 13:54:41,963 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:41,963 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:41,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:41,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:41,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:54:41,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:54:41,967 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,967 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:41,968 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,968 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5955c6ba[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:41,970 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:41,970 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,975 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,975 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:41,975 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:54:41,975 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:41,975 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,976 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:41,982 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:54:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:41,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:41,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:54:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:41,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:41,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:41,986 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:54:41,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:41,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:41,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,986 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:41,990 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,991 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:41,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,991 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:41,992 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,000 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:42,003 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:42,003 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:42,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:42,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-03 13:54:42,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,004 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:42,004 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:42,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:42,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:54:42,105 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:42,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:42,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-03 13:54:42,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:42,110 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:42,112 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020282111 2023-11-03 13:54:42,113 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:42,114 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:54:42,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-03 13:54:42,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,117 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x7738e060 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:42,155 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3528fd01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:42,155 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,240 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103254af0fb92ee48f1842df7696a4c278a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103254af0fb92ee48f1842df7696a4c278a 2023-11-03 13:54:42,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,288 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:42,290 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:42,301 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:42,302 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:42,323 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9221a3ea0c054f888a001a2b9b9f8c3c first=Optional[r5] last=Optional[r6] 2023-11-03 13:54:42,324 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9221a3ea0c054f888a001a2b9b9f8c3c}] 2023-11-03 13:54:42,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9221a3ea0c054f888a001a2b9b9f8c3c for inclusion in 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-03 13:54:42,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:42,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:42,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9221a3ea0c054f888a001a2b9b9f8c3c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mlc0pnan6fifvlj8mb44r4j0sjgvbcsl2hjsn3e0p3dsa1km1memt4oicaaa1sn4/family1/9221a3ea0c054f888a001a2b9b9f8c3c 2023-11-03 13:54:42,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mlc0pnan6fifvlj8mb44r4j0sjgvbcsl2hjsn3e0p3dsa1km1memt4oicaaa1sn4/family1/9221a3ea0c054f888a001a2b9b9f8c3c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_ 2023-11-03 13:54:42,346 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mlc0pnan6fifvlj8mb44r4j0sjgvbcsl2hjsn3e0p3dsa1km1memt4oicaaa1sn4/family1/9221a3ea0c054f888a001a2b9b9f8c3c into 31de55707a073f93015ed03c91cb49dc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_ - updating store file list. 2023-11-03 13:54:42,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_ into 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mlc0pnan6fifvlj8mb44r4j0sjgvbcsl2hjsn3e0p3dsa1km1memt4oicaaa1sn4/family1/9221a3ea0c054f888a001a2b9b9f8c3c into 31de55707a073f93015ed03c91cb49dc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_) 2023-11-03 13:54:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mlc0pnan6fifvlj8mb44r4j0sjgvbcsl2hjsn3e0p3dsa1km1memt4oicaaa1sn4/family1/9221a3ea0c054f888a001a2b9b9f8c3c 2023-11-03 13:54:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:54:42,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:54:42,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): 31de55707a073f93015ed03c91cb49dc/family1 is initiating minor compaction 2023-11-03 13:54:42,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5dece513; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:42,364 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 31de55707a073f93015ed03c91cb49dc/family1 in testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:54:42,364 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp, totalSize=49.7 K 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting aec1a43da9e8491d83bd0c369e28907f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 112b14d69de24d01bff5b2c8b7344a95, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 5bfb286a484b4aebaa1b193ba242029a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting c9e86d54cad244a29e42ba7c670730b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting b73d804a9ae2472e9ad2e6f382aa1520, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting d80612b0dfa0469593b11892541b4520, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:54:42,364 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 968eda63d5e3463990ccc4eb6cce923e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:54:42,365 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 557bddf680014598a327c510e360da03, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:54:42,365 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 31d4b0bda86c4a43a83c87a0bd1cc012, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:54:42,365 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:54:42,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,369 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:42,371 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010191566ee0eefd4523a1b113203110cd0d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010191566ee0eefd4523a1b113203110cd0d 2023-11-03 13:54:42,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103933ac6b474514d8582bcd4a6221a534b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103933ac6b474514d8582bcd4a6221a534b 2023-11-03 13:54:42,372 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-03 13:54:42,372 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-03 13:54:42,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,461 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 31de55707a073f93015ed03c91cb49dc#family1#compaction#22 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:42,517 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d80d7cc9b38841fd9978726afa7d3e81 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d80d7cc9b38841fd9978726afa7d3e81 2023-11-03 13:54:42,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,572 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f99618178692411ebd42e642bf7f1c7b first=Optional[r1] last=Optional[r4] 2023-11-03 13:54:42,573 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f99618178692411ebd42e642bf7f1c7b}] 2023-11-03 13:54:42,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f99618178692411ebd42e642bf7f1c7b for inclusion in 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-03 13:54:42,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:42,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:42,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f99618178692411ebd42e642bf7f1c7b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cmcqdq6o1avq5f4thq8jcqdcl5phnib4e7cml4mf7cgarnd1kj5a80lv86dl81pc/family1/f99618178692411ebd42e642bf7f1c7b 2023-11-03 13:54:42,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cmcqdq6o1avq5f4thq8jcqdcl5phnib4e7cml4mf7cgarnd1kj5a80lv86dl81pc/family1/f99618178692411ebd42e642bf7f1c7b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/be4bdd107a424f9e88172d1f1aee4e70_SeqId_46_ 2023-11-03 13:54:42,590 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cmcqdq6o1avq5f4thq8jcqdcl5phnib4e7cml4mf7cgarnd1kj5a80lv86dl81pc/family1/f99618178692411ebd42e642bf7f1c7b into 31de55707a073f93015ed03c91cb49dc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/be4bdd107a424f9e88172d1f1aee4e70_SeqId_46_ - updating store file list. 2023-11-03 13:54:42,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/be4bdd107a424f9e88172d1f1aee4e70_SeqId_46_ into 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cmcqdq6o1avq5f4thq8jcqdcl5phnib4e7cml4mf7cgarnd1kj5a80lv86dl81pc/family1/f99618178692411ebd42e642bf7f1c7b into 31de55707a073f93015ed03c91cb49dc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/be4bdd107a424f9e88172d1f1aee4e70_SeqId_46_) 2023-11-03 13:54:42,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cmcqdq6o1avq5f4thq8jcqdcl5phnib4e7cml4mf7cgarnd1kj5a80lv86dl81pc/family1/f99618178692411ebd42e642bf7f1c7b 2023-11-03 13:54:42,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,603 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:42,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120161ae867bf40b44198cbc88acf460ff5a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120161ae867bf40b44198cbc88acf460ff5a 2023-11-03 13:54:42,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae1a707b71434c49918eeeecb44e68a4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae1a707b71434c49918eeeecb44e68a4 2023-11-03 13:54:42,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c446d307c0854baba6352176db78d156 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c446d307c0854baba6352176db78d156 2023-11-03 13:54:42,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314bb15de7c6a942e9b35631d816ad3976 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314bb15de7c6a942e9b35631d816ad3976 2023-11-03 13:54:42,611 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-03 13:54:42,611 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-03 13:54:42,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ec3a3553d82a4934904d02258e766cb1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ec3a3553d82a4934904d02258e766cb1 2023-11-03 13:54:42,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,735 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/24f20c7ca76c4ee595d77cd0dbc01d21 first=Optional[r00] last=Optional[r8] 2023-11-03 13:54:42,736 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/24f20c7ca76c4ee595d77cd0dbc01d21}] 2023-11-03 13:54:42,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/24f20c7ca76c4ee595d77cd0dbc01d21 for inclusion in 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-03 13:54:42,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:42,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:42,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/24f20c7ca76c4ee595d77cd0dbc01d21 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ev6u5prgng4uddgpkd4ctvo2klsqse10otuetm0550ufff921605co1vokmbsom0/family1/24f20c7ca76c4ee595d77cd0dbc01d21 2023-11-03 13:54:42,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ev6u5prgng4uddgpkd4ctvo2klsqse10otuetm0550ufff921605co1vokmbsom0/family1/24f20c7ca76c4ee595d77cd0dbc01d21 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/e0bca995d1db46cf8d4f0197159f2866_SeqId_48_ 2023-11-03 13:54:42,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ev6u5prgng4uddgpkd4ctvo2klsqse10otuetm0550ufff921605co1vokmbsom0/family1/24f20c7ca76c4ee595d77cd0dbc01d21 into 31de55707a073f93015ed03c91cb49dc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/e0bca995d1db46cf8d4f0197159f2866_SeqId_48_ - updating store file list. 2023-11-03 13:54:42,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/e0bca995d1db46cf8d4f0197159f2866_SeqId_48_ into 31de55707a073f93015ed03c91cb49dc/family1 2023-11-03 13:54:42,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ev6u5prgng4uddgpkd4ctvo2klsqse10otuetm0550ufff921605co1vokmbsom0/family1/24f20c7ca76c4ee595d77cd0dbc01d21 into 31de55707a073f93015ed03c91cb49dc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/e0bca995d1db46cf8d4f0197159f2866_SeqId_48_) 2023-11-03 13:54:42,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ev6u5prgng4uddgpkd4ctvo2klsqse10otuetm0550ufff921605co1vokmbsom0/family1/24f20c7ca76c4ee595d77cd0dbc01d21 2023-11-03 13:54:42,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-11-03 13:54:42,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-03 13:54:42,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-03 13:54:42,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(415): Not compacting testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. because compaction request was cancelled 2023-11-03 13:54:42,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,784 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:42,786 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120025706c68a7444bbbec7958a10a7beec to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120025706c68a7444bbbec7958a10a7beec 2023-11-03 13:54:42,787 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128be2ae8b7fafd4979b20175745cfd8457 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128be2ae8b7fafd4979b20175745cfd8457 2023-11-03 13:54:42,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dc026ff45c4236ab7da59f62ca9ce3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dc026ff45c4236ab7da59f62ca9ce3 2023-11-03 13:54:42,789 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-03 13:54:42,789 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-03 13:54:42,789 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,789 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,789 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:54:42,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:54:42,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:42,791 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:42,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 683 msec 2023-11-03 13:54:42,970 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=262 (was 242) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/1732cbae97794b26b6dae03f1e8c363e java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34258 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16c0f3a4-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34248 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34210 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34218 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34196 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x7738e060-SendThread(127.0.0.1:53668) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:40984 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x7738e060-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x43be461d-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:41038 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34284 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34216 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:40928 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34238 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34228 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:40962 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:41012 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34266 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34250 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16c0f3a4-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:41044 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53668@0x7738e060 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1231824781.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_327162516_17 at /127.0.0.1:34234 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43be461d-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:41032 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16c0f3a4-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1884405660_17 at /127.0.0.1:34272 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=645 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1694 (was 1741), ProcessCount=194 (was 191) - ProcessCount LEAK? -, AvailableMemoryMB=252 (was 479) 2023-11-03 13:54:42,991 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=1694, ProcessCount=195, AvailableMemoryMB=250 2023-11-03 13:54:42,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:54:42,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:43,000 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:43,001 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:43,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-03 13:54:43,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:43,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:43,033 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf empty. 2023-11-03 13:54:43,035 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:43,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-03 13:54:43,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:43,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:43,322 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/.tmp/family1/1732cbae97794b26b6dae03f1e8c363e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/1732cbae97794b26b6dae03f1e8c363e 2023-11-03 13:54:43,358 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 31de55707a073f93015ed03c91cb49dc/family1 of 31de55707a073f93015ed03c91cb49dc into 1732cbae97794b26b6dae03f1e8c363e(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:54:43,359 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:54:43,359 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699019682363; duration=0sec 2023-11-03 13:54:43,359 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:43,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_] to archive 2023-11-03 13:54:43,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:43,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/aec1a43da9e8491d83bd0c369e28907f 2023-11-03 13:54:43,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/112b14d69de24d01bff5b2c8b7344a95 2023-11-03 13:54:43,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/5bfb286a484b4aebaa1b193ba242029a 2023-11-03 13:54:43,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c9e86d54cad244a29e42ba7c670730b6 2023-11-03 13:54:43,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/b73d804a9ae2472e9ad2e6f382aa1520 2023-11-03 13:54:43,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/d80612b0dfa0469593b11892541b4520 2023-11-03 13:54:43,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/968eda63d5e3463990ccc4eb6cce923e 2023-11-03 13:54:43,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/557bddf680014598a327c510e360da03 2023-11-03 13:54:43,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/31d4b0bda86c4a43a83c87a0bd1cc012 2023-11-03 13:54:43,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/family1/c920d71ce8b84600a719fbcc831c4fd2_SeqId_44_ 2023-11-03 13:54:43,540 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:43,543 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7a69c8b2f27947fa780cdacad82aecf, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:43,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing f7a69c8b2f27947fa780cdacad82aecf, disabling compactions & flushes 2023-11-03 13:54:44,006 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. after waiting 0 ms 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,006 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,006 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:44,010 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:44,011 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019684011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019684011"}]},"ts":"1699019684011"} 2023-11-03 13:54:44,013 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:54:44,015 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:44,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019684015"}]},"ts":"1699019684015"} 2023-11-03 13:54:44,017 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-03 13:54:44,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=f7a69c8b2f27947fa780cdacad82aecf, ASSIGN}] 2023-11-03 13:54:44,024 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=f7a69c8b2f27947fa780cdacad82aecf, ASSIGN 2023-11-03 13:54:44,025 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=f7a69c8b2f27947fa780cdacad82aecf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:44,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:44,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f7a69c8b2f27947fa780cdacad82aecf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:44,177 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019684176"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019684176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019684176"}]},"ts":"1699019684176"} 2023-11-03 13:54:44,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure f7a69c8b2f27947fa780cdacad82aecf, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:44,334 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:44,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7a69c8b2f27947fa780cdacad82aecf, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:44,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:44,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,341 INFO [StoreOpener-f7a69c8b2f27947fa780cdacad82aecf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,343 DEBUG [StoreOpener-f7a69c8b2f27947fa780cdacad82aecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:44,344 DEBUG [StoreOpener-f7a69c8b2f27947fa780cdacad82aecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:44,344 INFO [StoreOpener-f7a69c8b2f27947fa780cdacad82aecf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7a69c8b2f27947fa780cdacad82aecf columnFamilyName family1 2023-11-03 13:54:44,348 INFO [StoreOpener-f7a69c8b2f27947fa780cdacad82aecf-1] regionserver.HStore(310): Store=f7a69c8b2f27947fa780cdacad82aecf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:54:44,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:44,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f7a69c8b2f27947fa780cdacad82aecf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58852580, jitterRate=-0.1230282187461853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:54:44,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:44,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf., pid=25, masterSystemTime=1699019684334 2023-11-03 13:54:44,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:44,361 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f7a69c8b2f27947fa780cdacad82aecf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:44,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019684361"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019684361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019684361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019684361"}]},"ts":"1699019684361"} 2023-11-03 13:54:44,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-03 13:54:44,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure f7a69c8b2f27947fa780cdacad82aecf, server=jenkins-hbase20.apache.org,46707,1699019650288 in 185 msec 2023-11-03 13:54:44,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-03 13:54:44,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=f7a69c8b2f27947fa780cdacad82aecf, ASSIGN in 346 msec 2023-11-03 13:54:44,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:54:44,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019684371"}]},"ts":"1699019684371"} 2023-11-03 13:54:44,373 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-03 13:54:44,376 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:54:44,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.3810 sec 2023-11-03 13:54:44,656 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:45,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-03 13:54:45,119 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-03 13:54:45,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:45,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,198 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:45,198 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:45,198 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:45,198 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:45,200 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,200 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,202 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:45,202 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,202 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,202 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:45,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,207 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:45,207 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:45,207 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:45,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:45,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:45,215 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:45,215 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:45,219 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:54:45,705 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113032e712627c284246b2cc17f58021fff7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113032e712627c284246b2cc17f58021fff7 2023-11-03 13:54:45,709 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/c9fb51f3dd2648be997bc5868252399c 2023-11-03 13:54:45,716 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/c9fb51f3dd2648be997bc5868252399c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c 2023-11-03 13:54:45,725 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-03 13:54:45,726 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 507ms, sequenceid=5, compaction requested=false 2023-11-03 13:54:45,727 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:45,727 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:45,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:45,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:45,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:45,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:45,729 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:45,729 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:45,730 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,730 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:45,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:45,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aa987ff[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:45,732 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:45,732 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,733 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,733 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:45,733 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:45,733 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:45,734 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,734 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:45,735 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:45,735 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:45,735 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:45,735 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:45,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:45,739 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:45,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:45,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:45,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,739 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:45,741 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:45,741 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,741 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,741 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:45,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,743 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,745 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,745 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,745 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,745 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:45,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:45,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:45,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:45,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,746 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:45,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:45,846 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:45,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:45,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:45,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:45,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,855 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:45,856 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:45,856 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:45,856 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:45,856 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,856 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,861 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,861 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:45,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:45,862 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:45,862 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:45,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:45,865 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:45,865 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:45,865 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:45,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:45,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:45,866 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:45,866 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:45,866 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:54:46,315 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286c653b9bbd4449cf9ffc5fce459c62e8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511286c653b9bbd4449cf9ffc5fce459c62e8 2023-11-03 13:54:46,353 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/063e46301c7142769bc03b77950a5c8a 2023-11-03 13:54:46,381 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/063e46301c7142769bc03b77950a5c8a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a 2023-11-03 13:54:46,401 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:54:46,407 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 541ms, sequenceid=9, compaction requested=false 2023-11-03 13:54:46,407 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:46,407 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:46,407 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:46,408 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:46,408 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,408 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:46,408 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:46,414 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,414 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:46,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:46,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:46,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:46,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:46,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:46,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11c3eb4[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:46,422 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:46,423 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,443 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,443 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:46,443 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:46,443 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:46,450 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,450 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:46,455 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:46,457 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:46,457 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,457 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:46,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:46,460 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:46,460 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:46,460 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:46,460 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,460 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:46,466 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:46,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:46,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:46,470 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,471 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:46,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:46,475 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:46,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,484 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,494 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:46,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,495 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:46,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:46,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:46,496 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:46,496 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:46,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:46,596 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:46,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:46,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:46,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:46,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,615 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:46,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:46,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:46,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:46,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,615 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,617 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:46,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:46,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:46,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:46,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:46,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:46,625 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:46,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:46,635 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:46,635 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:46,642 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:46,642 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:46,643 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:47,104 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016e55cbc01ede4217b95b277b12200b98 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016e55cbc01ede4217b95b277b12200b98 2023-11-03 13:54:47,115 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/773380e4f3af4145b0981009a9c4f6df 2023-11-03 13:54:47,130 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/773380e4f3af4145b0981009a9c4f6df as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df 2023-11-03 13:54:47,146 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df, entries=1, sequenceid=13, filesize=4.9 K 2023-11-03 13:54:47,149 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 506ms, sequenceid=13, compaction requested=true 2023-11-03 13:54:47,149 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:47,149 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:47,149 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:47,149 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:47,149 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,149 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:47,149 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:47,151 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,151 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:47,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:47,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a36d59d[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:47,155 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:47,155 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,156 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:47,156 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,156 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:47,166 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:47,166 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:47,167 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:47,167 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:47,174 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:47,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:47,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:47,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,174 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:47,177 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,177 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,177 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,182 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,199 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:47,199 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:47,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:47,200 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,200 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:47,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:47,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:47,200 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,200 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:47,201 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:47,302 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:47,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:47,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:47,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:47,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,351 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:47,351 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:47,352 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:47,352 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:47,355 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,355 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,367 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,368 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:47,368 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:47,370 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:47,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:47,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:47,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:47,387 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:47,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:47,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:47,394 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:47,395 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:47,402 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:47,402 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:47,403 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:47,500 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ed0d55e0d3f849988afaa0b54c74f984 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ed0d55e0d3f849988afaa0b54c74f984 2023-11-03 13:54:47,962 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/79ef7f04cd954ae4936af5dcdef38b21 2023-11-03 13:54:48,003 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/79ef7f04cd954ae4936af5dcdef38b21 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21 2023-11-03 13:54:48,051 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21, entries=1, sequenceid=17, filesize=4.9 K 2023-11-03 13:54:48,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 651ms, sequenceid=17, compaction requested=true 2023-11-03 13:54:48,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:48,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:48,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:48,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:48,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,059 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:48,059 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:48,061 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:48,062 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:48,063 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,063 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:48,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:48,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:48,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:48,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d21a477[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:48,086 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:48,086 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,091 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,092 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:48,092 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:48,092 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:48,096 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,096 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:48,097 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:48,097 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:48,100 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:48,100 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:48,101 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:48,101 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:48,101 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:48,101 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,101 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:48,120 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,120 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:48,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,120 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,138 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,176 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,216 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,216 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,216 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,218 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:48,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:48,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:48,227 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:48,228 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:48,228 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:48,228 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:48,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:48,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:48,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:48,330 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:48,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:48,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:48,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:48,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,350 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:48,351 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:48,351 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:48,351 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:48,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,363 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:48,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:48,365 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,377 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,377 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:48,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,379 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:48,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:48,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:48,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:48,387 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:48,395 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:48,395 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:48,395 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:48,395 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:48,396 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:48,913 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d723bee3a12449718595f23961cbd106 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d723bee3a12449718595f23961cbd106 2023-11-03 13:54:48,939 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/254be804bb9b4275b6b7934417817c50 2023-11-03 13:54:48,967 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/254be804bb9b4275b6b7934417817c50 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50 2023-11-03 13:54:48,987 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50, entries=1, sequenceid=21, filesize=4.9 K 2023-11-03 13:54:48,989 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 593ms, sequenceid=21, compaction requested=true 2023-11-03 13:54:48,989 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:48,989 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:49,003 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:49,003 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b514453[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:49,009 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:49,009 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,019 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,020 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:49,020 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:49,020 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:49,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:49,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:49,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:49,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:49,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:49,035 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:49,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:49,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:49,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,035 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:49,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:49,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:49,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:49,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,051 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,054 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:49,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:49,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:49,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:49,085 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:49,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:49,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:49,085 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:49,085 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:49,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,186 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:49,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:49,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:49,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:49,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,218 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:49,218 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:49,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:49,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:49,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,232 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:49,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:49,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:49,233 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,240 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:49,240 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:49,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:49,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:49,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:49,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:49,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:49,282 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:49,282 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:49,282 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:49,282 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:49,282 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:49,776 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c6f203503bc3473799ed8bc2ce40a73b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c6f203503bc3473799ed8bc2ce40a73b 2023-11-03 13:54:49,893 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:54:50,186 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/941c9b007bc540dd8c00fb371b3b2cab 2023-11-03 13:54:50,204 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/941c9b007bc540dd8c00fb371b3b2cab as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab 2023-11-03 13:54:50,210 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab, entries=1, sequenceid=25, filesize=4.9 K 2023-11-03 13:54:50,212 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 930ms, sequenceid=25, compaction requested=true 2023-11-03 13:54:50,212 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:50,212 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:50,212 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:50,212 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:50,212 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,212 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:50,212 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:50,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:50,218 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,218 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:50,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:50,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bd82613[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:50,220 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:50,220 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,221 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,222 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:50,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:50,222 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:50,222 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:50,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:50,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:50,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:50,223 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:50,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:50,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:50,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:50,228 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:50,228 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:50,228 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:50,228 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,228 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:50,230 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,230 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,230 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:50,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:50,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,239 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:50,245 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:50,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:50,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:50,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:50,250 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:50,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:50,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:50,250 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:50,251 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:50,351 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:50,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:50,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:50,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:50,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,363 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:50,363 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:50,364 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:50,364 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:50,365 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,365 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,371 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,371 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:50,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,376 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:50,376 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:50,378 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:50,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:50,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:50,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:50,382 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:50,382 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:50,382 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:50,382 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:50,383 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:50,810 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d8daf99dfd6b483d9004f5299c3cff29 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8daf99dfd6b483d9004f5299c3cff29 2023-11-03 13:54:51,222 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/b2acee6003bf4334bce93d21d52a4fc3 2023-11-03 13:54:51,229 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/b2acee6003bf4334bce93d21d52a4fc3 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3 2023-11-03 13:54:51,236 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3, entries=1, sequenceid=29, filesize=4.9 K 2023-11-03 13:54:51,237 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 854ms, sequenceid=29, compaction requested=true 2023-11-03 13:54:51,237 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:51,237 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:51,237 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:51,237 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:51,237 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,238 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:51,238 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:51,239 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,239 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:51,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:51,239 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,239 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:51,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:51,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:51,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:51,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:51,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47ce98c8[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:51,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:51,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,243 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,243 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:51,243 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:51,243 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:51,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,243 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:51,246 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:51,247 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:51,247 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:51,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:51,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:51,250 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:51,250 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:51,250 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:51,250 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,250 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:51,282 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,282 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:51,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,282 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:51,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:51,282 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,284 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:51,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:51,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:54:51,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:51,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,286 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:51,287 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:51,287 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:51,387 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:51,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:51,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:51,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:51,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,403 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:51,404 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:51,404 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:51,404 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:51,405 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,405 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,406 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:51,406 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,411 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:51,411 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:51,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,412 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:51,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:51,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:51,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:51,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:51,413 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:51,413 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:51,413 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:51,413 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:51,413 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:51,840 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038bea1107906d468b9050cf29f79f72c5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038bea1107906d468b9050cf29f79f72c5 2023-11-03 13:54:52,277 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/06e86856d5044eab9b14f15bda25f7e2 2023-11-03 13:54:52,290 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/06e86856d5044eab9b14f15bda25f7e2 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2 2023-11-03 13:54:52,313 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2, entries=1, sequenceid=33, filesize=4.9 K 2023-11-03 13:54:52,315 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 902ms, sequenceid=33, compaction requested=true 2023-11-03 13:54:52,315 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:52,315 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:52,317 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:52,333 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,334 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:52,340 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,341 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:52,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:52,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78c8e5a[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:52,372 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:52,372 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,374 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,374 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,374 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:52,374 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:52,374 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:52,374 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:52,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:52,378 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,378 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:52,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:52,381 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:52,381 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:52,381 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:52,381 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,381 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:52,383 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,383 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:52,383 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:52,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:52,384 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:52,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,385 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:52,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,391 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,391 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,391 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,391 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,391 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,392 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:52,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:54:52,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:52,392 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,392 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:52,392 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:52,392 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:52,393 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:52,393 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:52,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:52,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:52,492 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:52,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,506 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:52,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:52,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:52,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:52,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,508 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,508 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:52,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:52,509 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:52,509 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,510 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:52,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:52,510 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:52,510 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:52,510 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:52,510 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:52,510 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:52,510 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:52,510 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:52,510 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:52,935 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079123e8e3e97f45d49e96f775954c4aa8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509079123e8e3e97f45d49e96f775954c4aa8 2023-11-03 13:54:53,345 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/d2ea1519372e4bba9d928dad13af4c3a 2023-11-03 13:54:53,352 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/d2ea1519372e4bba9d928dad13af4c3a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a 2023-11-03 13:54:53,359 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a, entries=1, sequenceid=37, filesize=4.9 K 2023-11-03 13:54:53,360 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 850ms, sequenceid=37, compaction requested=true 2023-11-03 13:54:53,360 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:53,361 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:53,362 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,362 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,362 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,362 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:53,364 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26de2124[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:53,364 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,365 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,365 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:53,365 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:53,365 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:53,365 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,365 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:53,366 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:53,367 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:53,367 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:53,367 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:53,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:53,370 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:53,370 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:53,370 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:53,370 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,370 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:53,373 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,373 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,373 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,374 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,376 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:53,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:53,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,382 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:53,382 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:53,383 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:53,483 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:53,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:53,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,492 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:53,492 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:53,492 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:54:53,493 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:54:53,493 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,493 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,494 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,494 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:53,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:53,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:53,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,496 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:54:53,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:53,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:54:53,498 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:54:53,498 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:53,498 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:53,498 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. started... 2023-11-03 13:54:53,499 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f7a69c8b2f27947fa780cdacad82aecf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:54:53,573 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204309c6d0285a418b9ee8aa363e702f10 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511204309c6d0285a418b9ee8aa363e702f10 2023-11-03 13:54:53,599 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/549bc07aa94d4b0ead5fbb515ed7e8bd 2023-11-03 13:54:53,617 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/549bc07aa94d4b0ead5fbb515ed7e8bd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd 2023-11-03 13:54:53,627 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd, entries=1, sequenceid=41, filesize=4.9 K 2023-11-03 13:54:53,628 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f7a69c8b2f27947fa780cdacad82aecf in 129ms, sequenceid=41, compaction requested=true 2023-11-03 13:54:53,629 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:53,629 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:53,629 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:54:53,629 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:54:53,629 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,629 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:54:53,629 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:54:53,632 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,632 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,633 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,633 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:54:53,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c3c7352[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:53,635 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:54:53,635 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,640 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,640 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:54:53,640 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:54:53,640 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:53,641 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,641 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:53,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:54:53,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:53,642 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:54:53,642 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:53,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:54:53,645 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:54:53,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:53,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:53,645 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,645 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:53,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,647 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:53,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,651 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,653 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:53,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:54:53,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-03 13:54:53,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:53,666 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:53,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:54:53,666 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:53,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:53,667 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:53,667 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:53,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:53,767 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:53,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:53,771 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-03 13:54:53,773 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:53,774 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:53,776 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020293776 2023-11-03 13:54:53,777 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:53,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:54:53,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-03 13:54:53,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:53,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x55ceefc5 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:53,808 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27fcd088, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:53,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,832 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033e1e51235ee544d3a40dd986f7b6826b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601033e1e51235ee544d3a40dd986f7b6826b 2023-11-03 13:54:54,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:54,846 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:54,847 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:54,854 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:54,856 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:54,869 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6213e2a8f7d40c6b47431aa4d38f580 first=Optional[r3] last=Optional[r6] 2023-11-03 13:54:54,869 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6213e2a8f7d40c6b47431aa4d38f580}] 2023-11-03 13:54:54,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6213e2a8f7d40c6b47431aa4d38f580 for inclusion in f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-03 13:54:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:54,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6213e2a8f7d40c6b47431aa4d38f580 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ch0rsflvm2233d4todlgkc2a5uv82c4jehlrr04l7156lc6lvr8et7h795knnm3s/family1/c6213e2a8f7d40c6b47431aa4d38f580 2023-11-03 13:54:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ch0rsflvm2233d4todlgkc2a5uv82c4jehlrr04l7156lc6lvr8et7h795knnm3s/family1/c6213e2a8f7d40c6b47431aa4d38f580 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_ 2023-11-03 13:54:54,883 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ch0rsflvm2233d4todlgkc2a5uv82c4jehlrr04l7156lc6lvr8et7h795knnm3s/family1/c6213e2a8f7d40c6b47431aa4d38f580 into f7a69c8b2f27947fa780cdacad82aecf/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_ - updating store file list. 2023-11-03 13:54:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_ into f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ch0rsflvm2233d4todlgkc2a5uv82c4jehlrr04l7156lc6lvr8et7h795knnm3s/family1/c6213e2a8f7d40c6b47431aa4d38f580 into f7a69c8b2f27947fa780cdacad82aecf/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_) 2023-11-03 13:54:54,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ch0rsflvm2233d4todlgkc2a5uv82c4jehlrr04l7156lc6lvr8et7h795knnm3s/family1/c6213e2a8f7d40c6b47431aa4d38f580 2023-11-03 13:54:54,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:54:54,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:54:54,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): f7a69c8b2f27947fa780cdacad82aecf/family1 is initiating minor compaction 2023-11-03 13:54:54,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@acf4dd1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:54,895 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f7a69c8b2f27947fa780cdacad82aecf/family1 in testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:54,896 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp, totalSize=50.0 K 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 063e46301c7142769bc03b77950a5c8a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 773380e4f3af4145b0981009a9c4f6df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 79ef7f04cd954ae4936af5dcdef38b21, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 254be804bb9b4275b6b7934417817c50, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 941c9b007bc540dd8c00fb371b3b2cab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:54:54,896 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting b2acee6003bf4334bce93d21d52a4fc3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:54:54,897 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 06e86856d5044eab9b14f15bda25f7e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:54:54,897 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting d2ea1519372e4bba9d928dad13af4c3a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:54:54,897 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 549bc07aa94d4b0ead5fbb515ed7e8bd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:54:54,897 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 89bf39429cf446c8901ec80be4954324_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:54:54,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:54,899 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:54,901 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d723bee3a12449718595f23961cbd106 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d723bee3a12449718595f23961cbd106 2023-11-03 13:54:54,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c6f203503bc3473799ed8bc2ce40a73b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c6f203503bc3473799ed8bc2ce40a73b 2023-11-03 13:54:54,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8daf99dfd6b483d9004f5299c3cff29 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8daf99dfd6b483d9004f5299c3cff29 2023-11-03 13:54:54,908 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038bea1107906d468b9050cf29f79f72c5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038bea1107906d468b9050cf29f79f72c5 2023-11-03 13:54:54,908 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-03 13:54:54,908 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-03 13:54:54,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:54,942 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): f7a69c8b2f27947fa780cdacad82aecf#family1#compaction#33 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:55,369 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c1666effff2b47b4a6ff349df1c9f8af to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c1666effff2b47b4a6ff349df1c9f8af 2023-11-03 13:54:55,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:55,377 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/4ad78de5689a406d9a2dabb548ee65fc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/4ad78de5689a406d9a2dabb548ee65fc 2023-11-03 13:54:55,390 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f7a69c8b2f27947fa780cdacad82aecf/family1 of f7a69c8b2f27947fa780cdacad82aecf into 4ad78de5689a406d9a2dabb548ee65fc(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:54:55,391 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:55,391 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699019694895; duration=0sec 2023-11-03 13:54:55,391 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:55,424 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9693217ddcb040df8dd402c7bf68d415 first=Optional[r1] last=Optional[r2] 2023-11-03 13:54:55,425 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9693217ddcb040df8dd402c7bf68d415}] 2023-11-03 13:54:55,431 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9693217ddcb040df8dd402c7bf68d415 for inclusion in f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:55,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-03 13:54:55,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:54:55,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:55,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9693217ddcb040df8dd402c7bf68d415 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r9e7emt2sb200kk9518apqd8026b4gkvr521bunri6rt0vnct4sp29ucabt7cc7u/family1/9693217ddcb040df8dd402c7bf68d415 2023-11-03 13:54:55,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r9e7emt2sb200kk9518apqd8026b4gkvr521bunri6rt0vnct4sp29ucabt7cc7u/family1/9693217ddcb040df8dd402c7bf68d415 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_ 2023-11-03 13:54:55,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r9e7emt2sb200kk9518apqd8026b4gkvr521bunri6rt0vnct4sp29ucabt7cc7u/family1/9693217ddcb040df8dd402c7bf68d415 into f7a69c8b2f27947fa780cdacad82aecf/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_ - updating store file list. 2023-11-03 13:54:55,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_] to archive 2023-11-03 13:54:55,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:55,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/063e46301c7142769bc03b77950a5c8a 2023-11-03 13:54:55,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_ into f7a69c8b2f27947fa780cdacad82aecf/family1 2023-11-03 13:54:55,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r9e7emt2sb200kk9518apqd8026b4gkvr521bunri6rt0vnct4sp29ucabt7cc7u/family1/9693217ddcb040df8dd402c7bf68d415 into f7a69c8b2f27947fa780cdacad82aecf/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_) 2023-11-03 13:54:55,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r9e7emt2sb200kk9518apqd8026b4gkvr521bunri6rt0vnct4sp29ucabt7cc7u/family1/9693217ddcb040df8dd402c7bf68d415 2023-11-03 13:54:55,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:54:55,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/773380e4f3af4145b0981009a9c4f6df 2023-11-03 13:54:55,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:54:55,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): f7a69c8b2f27947fa780cdacad82aecf/family1 is initiating minor compaction (all files) 2023-11-03 13:54:55,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@321c47a9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:55,478 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f7a69c8b2f27947fa780cdacad82aecf/family1 in testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:54:55,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/79ef7f04cd954ae4936af5dcdef38b21 2023-11-03 13:54:55,479 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/4ad78de5689a406d9a2dabb548ee65fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp, totalSize=176.8 K 2023-11-03 13:54:55,480 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting c9fb51f3dd2648be997bc5868252399c, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:54:55,480 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 4ad78de5689a406d9a2dabb548ee65fc, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:54:55,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/254be804bb9b4275b6b7934417817c50 2023-11-03 13:54:55,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:55,481 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965217029 2023-11-03 13:54:55,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:55,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/941c9b007bc540dd8c00fb371b3b2cab 2023-11-03 13:54:55,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016e55cbc01ede4217b95b277b12200b98 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016e55cbc01ede4217b95b277b12200b98 2023-11-03 13:54:55,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/b2acee6003bf4334bce93d21d52a4fc3 2023-11-03 13:54:55,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/06e86856d5044eab9b14f15bda25f7e2 2023-11-03 13:54:55,492 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ed0d55e0d3f849988afaa0b54c74f984 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ed0d55e0d3f849988afaa0b54c74f984 2023-11-03 13:54:55,492 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-03 13:54:55,492 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-03 13:54:55,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d2ea1519372e4bba9d928dad13af4c3a 2023-11-03 13:54:55,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:54:55,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:54:55,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:55,500 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:54:55,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/549bc07aa94d4b0ead5fbb515ed7e8bd 2023-11-03 13:54:55,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.7280 sec 2023-11-03 13:54:55,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/89bf39429cf446c8901ec80be4954324_SeqId_44_ 2023-11-03 13:54:55,532 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): f7a69c8b2f27947fa780cdacad82aecf#family1#compaction#34 average throughput is 7.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:55,724 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 262), OpenFileDescriptor=637 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1520 (was 1694), ProcessCount=191 (was 195), AvailableMemoryMB=700 (was 250) - AvailableMemoryMB LEAK? - 2023-11-03 13:54:55,743 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=639, MaxFileDescriptor=60000, SystemLoadAverage=1520, ProcessCount=191, AvailableMemoryMB=697 2023-11-03 13:54:55,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-03 13:54:55,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:55,753 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:55,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-03 13:54:55,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:55,755 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:55,758 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:55,758 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:55,758 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:55,759 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2 empty. 2023-11-03 13:54:55,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86 empty. 2023-11-03 13:54:55,759 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a empty. 2023-11-03 13:54:55,760 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:55,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:55,760 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:55,760 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-03 13:54:55,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:56,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:56,180 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:56,182 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => dea5da2d9fa5173fe36f181ac69bffb2, NAME => 'testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:56,182 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => be67baf7df661516c1e6c1e7f11a0c3a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:56,187 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7fff8698e9e97b529f7baca6d3aa3f86, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:56,335 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:56,335 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 7fff8698e9e97b529f7baca6d3aa3f86, disabling compactions & flushes 2023-11-03 13:54:56,335 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:56,336 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:56,336 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. after waiting 0 ms 2023-11-03 13:54:56,336 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:56,336 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:56,336 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:54:56,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:56,462 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/.tmp/family1/9897ffac28ea405a8061fb17b6a00174 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/9897ffac28ea405a8061fb17b6a00174 2023-11-03 13:54:56,502 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f7a69c8b2f27947fa780cdacad82aecf/family1 of f7a69c8b2f27947fa780cdacad82aecf into 9897ffac28ea405a8061fb17b6a00174(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:54:56,503 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:54:56,503 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1699019695478; duration=1sec 2023-11-03 13:54:56,503 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:56,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/4ad78de5689a406d9a2dabb548ee65fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_] to archive 2023-11-03 13:54:56,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:56,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/c9fb51f3dd2648be997bc5868252399c 2023-11-03 13:54:56,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/4ad78de5689a406d9a2dabb548ee65fc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/4ad78de5689a406d9a2dabb548ee65fc 2023-11-03 13:54:56,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/family1/d3b5ba66dfd941febc9e666d0c5861c5_SeqId_47_ 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing dea5da2d9fa5173fe36f181ac69bffb2, disabling compactions & flushes 2023-11-03 13:54:56,691 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. after waiting 0 ms 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:56,691 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:56,691 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for dea5da2d9fa5173fe36f181ac69bffb2: 2023-11-03 13:54:56,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:56,718 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing be67baf7df661516c1e6c1e7f11a0c3a, disabling compactions & flushes 2023-11-03 13:54:56,718 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:56,718 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:56,718 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. after waiting 0 ms 2023-11-03 13:54:56,718 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:56,718 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:56,718 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for be67baf7df661516c1e6c1e7f11a0c3a: 2023-11-03 13:54:56,725 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:56,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019696733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019696733"}]},"ts":"1699019696733"} 2023-11-03 13:54:56,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019696733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019696733"}]},"ts":"1699019696733"} 2023-11-03 13:54:56,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699019696733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019696733"}]},"ts":"1699019696733"} 2023-11-03 13:54:56,744 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-03 13:54:56,751 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:56,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019696751"}]},"ts":"1699019696751"} 2023-11-03 13:54:56,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-03 13:54:56,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea5da2d9fa5173fe36f181ac69bffb2, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be67baf7df661516c1e6c1e7f11a0c3a, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7fff8698e9e97b529f7baca6d3aa3f86, ASSIGN}] 2023-11-03 13:54:56,772 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea5da2d9fa5173fe36f181ac69bffb2, ASSIGN 2023-11-03 13:54:56,773 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be67baf7df661516c1e6c1e7f11a0c3a, ASSIGN 2023-11-03 13:54:56,773 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7fff8698e9e97b529f7baca6d3aa3f86, ASSIGN 2023-11-03 13:54:56,777 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea5da2d9fa5173fe36f181ac69bffb2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:56,778 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be67baf7df661516c1e6c1e7f11a0c3a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:56,777 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7fff8698e9e97b529f7baca6d3aa3f86, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:56,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:56,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dea5da2d9fa5173fe36f181ac69bffb2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:56,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=7fff8698e9e97b529f7baca6d3aa3f86, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:56,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019696930"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019696930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019696930"}]},"ts":"1699019696930"} 2023-11-03 13:54:56,931 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=be67baf7df661516c1e6c1e7f11a0c3a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:56,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019696930"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019696930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019696930"}]},"ts":"1699019696930"} 2023-11-03 13:54:56,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699019696931"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019696931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019696931"}]},"ts":"1699019696931"} 2023-11-03 13:54:56,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure dea5da2d9fa5173fe36f181ac69bffb2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:56,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 7fff8698e9e97b529f7baca6d3aa3f86, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:56,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure be67baf7df661516c1e6c1e7f11a0c3a, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:57,086 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:57,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be67baf7df661516c1e6c1e7f11a0c3a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-03 13:54:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,094 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,098 DEBUG [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/family1 2023-11-03 13:54:57,098 DEBUG [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/family1 2023-11-03 13:54:57,098 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be67baf7df661516c1e6c1e7f11a0c3a columnFamilyName family1 2023-11-03 13:54:57,100 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] regionserver.HStore(310): Store=be67baf7df661516c1e6c1e7f11a0c3a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,100 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,102 DEBUG [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/family2 2023-11-03 13:54:57,102 DEBUG [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/family2 2023-11-03 13:54:57,103 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be67baf7df661516c1e6c1e7f11a0c3a columnFamilyName family2 2023-11-03 13:54:57,104 INFO [StoreOpener-be67baf7df661516c1e6c1e7f11a0c3a-1] regionserver.HStore(310): Store=be67baf7df661516c1e6c1e7f11a0c3a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:54:57,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:54:57,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:57,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened be67baf7df661516c1e6c1e7f11a0c3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72142482, jitterRate=0.07500675320625305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:54:57,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for be67baf7df661516c1e6c1e7f11a0c3a: 2023-11-03 13:54:57,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a., pid=33, masterSystemTime=1699019697086 2023-11-03 13:54:57,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:57,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:57,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dea5da2d9fa5173fe36f181ac69bffb2, NAME => 'testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.', STARTKEY => '', ENDKEY => '1'} 2023-11-03 13:54:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,118 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=be67baf7df661516c1e6c1e7f11a0c3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699019697118"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019697118"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019697118"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019697118"}]},"ts":"1699019697118"} 2023-11-03 13:54:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,121 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-11-03 13:54:57,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure be67baf7df661516c1e6c1e7f11a0c3a, server=jenkins-hbase20.apache.org,46707,1699019650288 in 183 msec 2023-11-03 13:54:57,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be67baf7df661516c1e6c1e7f11a0c3a, ASSIGN in 360 msec 2023-11-03 13:54:57,129 DEBUG [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/family1 2023-11-03 13:54:57,129 DEBUG [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/family1 2023-11-03 13:54:57,130 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea5da2d9fa5173fe36f181ac69bffb2 columnFamilyName family1 2023-11-03 13:54:57,131 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] regionserver.HStore(310): Store=dea5da2d9fa5173fe36f181ac69bffb2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,132 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,134 DEBUG [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/family2 2023-11-03 13:54:57,135 DEBUG [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/family2 2023-11-03 13:54:57,136 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea5da2d9fa5173fe36f181ac69bffb2 columnFamilyName family2 2023-11-03 13:54:57,137 INFO [StoreOpener-dea5da2d9fa5173fe36f181ac69bffb2-1] regionserver.HStore(310): Store=dea5da2d9fa5173fe36f181ac69bffb2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:54:57,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:54:57,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:57,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened dea5da2d9fa5173fe36f181ac69bffb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71291137, jitterRate=0.06232072412967682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:54:57,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for dea5da2d9fa5173fe36f181ac69bffb2: 2023-11-03 13:54:57,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2., pid=31, masterSystemTime=1699019697086 2023-11-03 13:54:57,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:57,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:57,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7fff8698e9e97b529f7baca6d3aa3f86, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.', STARTKEY => '2', ENDKEY => ''} 2023-11-03 13:54:57,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dea5da2d9fa5173fe36f181ac69bffb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:57,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019697153"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019697153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019697153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019697153"}]},"ts":"1699019697153"} 2023-11-03 13:54:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,159 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,160 DEBUG [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1 2023-11-03 13:54:57,161 DEBUG [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1 2023-11-03 13:54:57,161 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fff8698e9e97b529f7baca6d3aa3f86 columnFamilyName family1 2023-11-03 13:54:57,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-11-03 13:54:57,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure dea5da2d9fa5173fe36f181ac69bffb2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 226 msec 2023-11-03 13:54:57,163 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] regionserver.HStore(310): Store=7fff8698e9e97b529f7baca6d3aa3f86/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,163 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea5da2d9fa5173fe36f181ac69bffb2, ASSIGN in 396 msec 2023-11-03 13:54:57,168 DEBUG [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family2 2023-11-03 13:54:57,168 DEBUG [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family2 2023-11-03 13:54:57,169 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fff8698e9e97b529f7baca6d3aa3f86 columnFamilyName family2 2023-11-03 13:54:57,171 INFO [StoreOpener-7fff8698e9e97b529f7baca6d3aa3f86-1] regionserver.HStore(310): Store=7fff8698e9e97b529f7baca6d3aa3f86/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:54:57,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:54:57,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:54:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:54:57,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7fff8698e9e97b529f7baca6d3aa3f86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59314228, jitterRate=-0.11614912748336792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:54:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:54:57,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86., pid=32, masterSystemTime=1699019697086 2023-11-03 13:54:57,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:57,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:57,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=7fff8698e9e97b529f7baca6d3aa3f86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699019697200"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019697200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019697200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019697200"}]},"ts":"1699019697200"} 2023-11-03 13:54:57,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-11-03 13:54:57,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 7fff8698e9e97b529f7baca6d3aa3f86, server=jenkins-hbase20.apache.org,46707,1699019650288 in 266 msec 2023-11-03 13:54:57,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-03 13:54:57,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7fff8698e9e97b529f7baca6d3aa3f86, ASSIGN in 485 msec 2023-11-03 13:54:57,259 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:54:57,259 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019697259"}]},"ts":"1699019697259"} 2023-11-03 13:54:57,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-03 13:54:57,284 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:54:57,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.5360 sec 2023-11-03 13:54:57,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-03 13:54:57,884 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-03 13:54:57,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:57,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,930 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-03 13:54:57,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:57,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-03 13:54:57,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-03 13:54:57,939 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,939 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,956 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:57,956 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:57,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:57,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:57,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:57,985 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-03 13:54:57,985 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:57,985 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-03 13:54:57,986 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:57,986 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. started... 2023-11-03 13:54:57,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:54:57,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:57,991 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:57,991 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. started... 2023-11-03 13:54:57,991 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be67baf7df661516c1e6c1e7f11a0c3a: 2023-11-03 13:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dea5da2d9fa5173fe36f181ac69bffb2: 2023-11-03 13:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:57,993 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:54:57,994 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:57,994 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. started... 2023-11-03 13:54:57,995 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fff8698e9e97b529f7baca6d3aa3f86 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-03 13:54:58,043 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311037ea828e949bf47b680e7d1823d2a1edd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311037ea828e949bf47b680e7d1823d2a1edd 2023-11-03 13:54:58,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp/family1/90a9351f40f642498a6162bd55ac9b71 2023-11-03 13:54:58,064 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp/family1/90a9351f40f642498a6162bd55ac9b71 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71 2023-11-03 13:54:58,071 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71, entries=1, sequenceid=5, filesize=4.9 K 2023-11-03 13:54:58,072 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 7fff8698e9e97b529f7baca6d3aa3f86 in 77ms, sequenceid=5, compaction requested=false 2023-11-03 13:54:58,072 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-03 13:54:58,073 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:54:58,073 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:58,073 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:54:58,073 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:54:58,073 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,073 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-03 13:54:58,073 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-03 13:54:58,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:58,075 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:58,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:58,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:58,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-03 13:54:58,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f07a6c5[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:58,078 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-03 13:54:58,078 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,078 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,078 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:58,079 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-03 13:54:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-03 13:54:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:58,080 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,080 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:58,082 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,083 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-03 13:54:58,083 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:58,083 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-03 13:54:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:58,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:58,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-03 13:54:58,100 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-03 13:54:58,100 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:58,100 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:58,100 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,100 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:58,103 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:58,103 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,103 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:58,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:58,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:58,111 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,123 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:58,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:58,124 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:58,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:58,125 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:58,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-03 13:54:58,125 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-03 13:54:58,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:58,125 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:58,125 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:58,125 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,225 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:58,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:58,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:54:58,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-03 13:54:58,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,235 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-03 13:54:58,235 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:58,235 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-03 13:54:58,235 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-03 13:54:58,235 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,235 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,238 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:58,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:58,239 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:58,242 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:54:58,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:54:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-03 13:54:58,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:58,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-03 13:54:58,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:54:58,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-03 13:54:58,244 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:58,244 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. started... 2023-11-03 13:54:58,244 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be67baf7df661516c1e6c1e7f11a0c3a: 2023-11-03 13:54:58,244 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:54:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:54:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:54:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:54:58,250 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:58,254 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:58,254 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. started... 2023-11-03 13:54:58,254 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fff8698e9e97b529f7baca6d3aa3f86 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-03 13:54:58,254 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. started... 2023-11-03 13:54:58,255 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dea5da2d9fa5173fe36f181ac69bffb2: 2023-11-03 13:54:58,255 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:54:58,255 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:54:58,673 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311036ba9294ebba649e9b90defa4a9b8e781 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311036ba9294ebba649e9b90defa4a9b8e781 2023-11-03 13:54:59,080 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp/family1/4afaea42e4c443c8a8b6399bff50c4c6 2023-11-03 13:54:59,097 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp/family1/4afaea42e4c443c8a8b6399bff50c4c6 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6 2023-11-03 13:54:59,104 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6, entries=2, sequenceid=9, filesize=5.0 K 2023-11-03 13:54:59,105 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 7fff8698e9e97b529f7baca6d3aa3f86 in 851ms, sequenceid=9, compaction requested=false 2023-11-03 13:54:59,105 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:54:59,105 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:59,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:54:59,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:54:59,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-03 13:54:59,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-03 13:54:59,107 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,107 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:59,107 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,107 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:54:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-03 13:54:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c9a0521[Count = 0] remaining members to acquire global barrier 2023-11-03 13:54:59,109 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-03 13:54:59,109 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-03 13:54:59,110 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,110 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:54:59,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-03 13:54:59,111 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:54:59,112 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,112 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-03 13:54:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:59,112 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:59,112 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-03 13:54:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:54:59,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-03 13:54:59,115 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-03 13:54:59,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:54:59,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:54:59,116 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,116 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:54:59,125 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,125 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:59,125 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:54:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:54:59,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:54:59,126 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:54:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,129 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:54:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,136 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:54:59,136 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:54:59,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:54:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:54:59,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:54:59,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,140 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:54:59,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-03 13:54:59,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:54:59,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,140 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,142 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-03 13:54:59,142 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:54:59,246 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:54:59,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:54:59,258 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-03 13:54:59,260 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-03 13:54:59,261 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-03 13:54:59,261 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020299261 2023-11-03 13:54:59,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:59,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:54:59,263 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-03 13:54:59,263 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-03 13:54:59,265 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x781f4862 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:54:59,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3926af79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:54:59,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231103 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-03 13:54:59,381 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110329fefa3c81dd40a6ac80fad287d44418 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110329fefa3c81dd40a6ac80fad287d44418 2023-11-03 13:54:59,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-03 13:54:59,414 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:54:59,415 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:54:59,475 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:54:59,479 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:54:59,500 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231103/family1/e6c8fe9a5a414c9687486ee2732afa22 first=Optional[k0] last=Optional[k1] 2023-11-03 13:54:59,501 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231103/family1/e6c8fe9a5a414c9687486ee2732afa22}] 2023-11-03 13:54:59,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231103/family1/e6c8fe9a5a414c9687486ee2732afa22 for inclusion in 7fff8698e9e97b529f7baca6d3aa3f86/family1 2023-11-03 13:54:59,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-03 13:54:59,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-03 13:54:59,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:54:59,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231103/family1/e6c8fe9a5a414c9687486ee2732afa22 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testScannerOnBulkLoadRefHFiles__r4q4q15ko4auhq8flkhvrromud4uabe8cijp18naupd2r2k6sdsmmsg72meb5ram/family1/e6c8fe9a5a414c9687486ee2732afa22 2023-11-03 13:54:59,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testScannerOnBulkLoadRefHFiles__r4q4q15ko4auhq8flkhvrromud4uabe8cijp18naupd2r2k6sdsmmsg72meb5ram/family1/e6c8fe9a5a414c9687486ee2732afa22 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_ 2023-11-03 13:54:59,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testScannerOnBulkLoadRefHFiles__r4q4q15ko4auhq8flkhvrromud4uabe8cijp18naupd2r2k6sdsmmsg72meb5ram/family1/e6c8fe9a5a414c9687486ee2732afa22 into 7fff8698e9e97b529f7baca6d3aa3f86/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_ - updating store file list. 2023-11-03 13:54:59,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_ into 7fff8698e9e97b529f7baca6d3aa3f86/family1 2023-11-03 13:54:59,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testScannerOnBulkLoadRefHFiles__r4q4q15ko4auhq8flkhvrromud4uabe8cijp18naupd2r2k6sdsmmsg72meb5ram/family1/e6c8fe9a5a414c9687486ee2732afa22 into 7fff8698e9e97b529f7baca6d3aa3f86/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_) 2023-11-03 13:54:59,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testScannerOnBulkLoadRefHFiles__r4q4q15ko4auhq8flkhvrromud4uabe8cijp18naupd2r2k6sdsmmsg72meb5ram/family1/e6c8fe9a5a414c9687486ee2732afa22 2023-11-03 13:54:59,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:54:59,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:54:59,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): 7fff8698e9e97b529f7baca6d3aa3f86/family1 is initiating minor compaction (all files) 2023-11-03 13:54:59,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@61a97a0e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:54:59,536 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7fff8698e9e97b529f7baca6d3aa3f86/family1 in testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:54:59,536 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp, totalSize=15.1 K 2023-11-03 13:54:59,537 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 90a9351f40f642498a6162bd55ac9b71, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019697884 2023-11-03 13:54:59,538 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 4afaea42e4c443c8a8b6399bff50c4c6, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019697884 2023-11-03 13:54:59,539 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting b37b01a2460d4285a1eeb148dea7e527_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019697884 2023-11-03 13:54:59,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-03 13:54:59,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:54:59,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311036ba9294ebba649e9b90defa4a9b8e781 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311036ba9294ebba649e9b90defa4a9b8e781 2023-11-03 13:54:59,544 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311037ea828e949bf47b680e7d1823d2a1edd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311037ea828e949bf47b680e7d1823d2a1edd 2023-11-03 13:54:59,544 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-03 13:54:59,544 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231103' 2023-11-03 13:54:59,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231103 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-03 13:54:59,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-03 13:54:59,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:54:59,546 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-03 13:54:59,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 287 msec 2023-11-03 13:54:59,554 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7fff8698e9e97b529f7baca6d3aa3f86#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:54:59,589 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=265 (was 259) - Thread LEAK? -, OpenFileDescriptor=643 (was 639) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1478 (was 1520), ProcessCount=191 (was 191), AvailableMemoryMB=394 (was 697) 2023-11-03 13:54:59,606 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=1478, ProcessCount=191, AvailableMemoryMB=394 2023-11-03 13:54:59,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:54:59,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-03 13:54:59,614 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:54:59,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-03 13:54:59,616 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:54:59,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-03 13:54:59,617 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:54:59,618 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5 empty. 2023-11-03 13:54:59,618 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:54:59,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-03 13:54:59,630 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-03 13:54:59,633 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9698b8a3cd29c99df62020ad84c00ed5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:54:59,656 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:59,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 9698b8a3cd29c99df62020ad84c00ed5, disabling compactions & flushes 2023-11-03 13:54:59,657 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:54:59,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:54:59,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. after waiting 0 ms 2023-11-03 13:54:59,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:54:59,657 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:54:59,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:54:59,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:54:59,672 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019699672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019699672"}]},"ts":"1699019699672"} 2023-11-03 13:54:59,674 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:54:59,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:54:59,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019699676"}]},"ts":"1699019699676"} 2023-11-03 13:54:59,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-03 13:54:59,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9698b8a3cd29c99df62020ad84c00ed5, ASSIGN}] 2023-11-03 13:54:59,684 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9698b8a3cd29c99df62020ad84c00ed5, ASSIGN 2023-11-03 13:54:59,686 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9698b8a3cd29c99df62020ad84c00ed5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:54:59,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-03 13:54:59,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9698b8a3cd29c99df62020ad84c00ed5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019699837"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019699837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019699837"}]},"ts":"1699019699837"} 2023-11-03 13:54:59,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 9698b8a3cd29c99df62020ad84c00ed5, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:54:59,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-03 13:54:59,993 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:54:59,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:54:59,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9698b8a3cd29c99df62020ad84c00ed5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:54:59,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:54:59,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:54:59,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:54:59,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:55:00,008 INFO [StoreOpener-9698b8a3cd29c99df62020ad84c00ed5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:55:00,023 DEBUG [StoreOpener-9698b8a3cd29c99df62020ad84c00ed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:00,023 DEBUG [StoreOpener-9698b8a3cd29c99df62020ad84c00ed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:00,024 INFO [StoreOpener-9698b8a3cd29c99df62020ad84c00ed5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9698b8a3cd29c99df62020ad84c00ed5 columnFamilyName family1 2023-11-03 13:55:00,029 INFO [StoreOpener-9698b8a3cd29c99df62020ad84c00ed5-1] regionserver.HStore(310): Store=9698b8a3cd29c99df62020ad84c00ed5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:00,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:55:00,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:55:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:55:00,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:00,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9698b8a3cd29c99df62020ad84c00ed5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65653687, jitterRate=-0.02168382704257965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:00,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:00,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5., pid=37, masterSystemTime=1699019699993 2023-11-03 13:55:00,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9698b8a3cd29c99df62020ad84c00ed5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699019700052"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019700052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019700052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019700052"}]},"ts":"1699019700052"} 2023-11-03 13:55:00,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-03 13:55:00,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 9698b8a3cd29c99df62020ad84c00ed5, server=jenkins-hbase20.apache.org,46707,1699019650288 in 214 msec 2023-11-03 13:55:00,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-03 13:55:00,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9698b8a3cd29c99df62020ad84c00ed5, ASSIGN in 377 msec 2023-11-03 13:55:00,064 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:55:00,064 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019700064"}]},"ts":"1699019700064"} 2023-11-03 13:55:00,066 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-03 13:55:00,073 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:55:00,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 462 msec 2023-11-03 13:55:00,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-03 13:55:00,220 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-03 13:55:00,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,260 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:00,260 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:00,260 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:00,260 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:00,261 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,261 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,262 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:00,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:00,262 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,263 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,263 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:00,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,265 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:00,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:00,266 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:00,271 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:00,271 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,271 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:00,271 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:00,272 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:55:00,299 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130077e6d883b744cc8b27b418a1626beea to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130077e6d883b744cc8b27b418a1626beea 2023-11-03 13:55:00,386 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/.tmp/family1/96790c3f98e04a7283d71a362d212831 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/96790c3f98e04a7283d71a362d212831 2023-11-03 13:55:00,393 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7fff8698e9e97b529f7baca6d3aa3f86/family1 of 7fff8698e9e97b529f7baca6d3aa3f86 into 96790c3f98e04a7283d71a362d212831(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:00,393 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:55:00,394 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699019699536; duration=0sec 2023-11-03 13:55:00,394 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:00,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_] to archive 2023-11-03 13:55:00,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:00,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/90a9351f40f642498a6162bd55ac9b71 2023-11-03 13:55:00,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/4afaea42e4c443c8a8b6399bff50c4c6 2023-11-03 13:55:00,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/family1/b37b01a2460d4285a1eeb148dea7e527_SeqId_12_ 2023-11-03 13:55:00,706 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/d209865463ca428b986fb81a588c8347 2023-11-03 13:55:00,712 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/d209865463ca428b986fb81a588c8347 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347 2023-11-03 13:55:00,717 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-03 13:55:00,718 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 446ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:00,718 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:00,719 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:00,719 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:00,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:00,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:00,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:00,721 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,721 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,721 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,721 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:00,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b9adc97[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:00,723 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:00,723 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,724 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,724 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:00,725 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:00,725 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:00,725 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,725 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:00,726 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:00,726 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,726 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,726 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:00,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:00,729 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:00,729 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:00,729 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:00,730 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,730 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:00,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,740 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,742 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,743 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,743 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:00,744 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:00,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:00,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:00,744 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,845 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:00,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:00,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:00,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,857 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:00,857 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:00,858 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:00,858 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:00,860 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,860 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,862 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:00,862 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:00,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:00,863 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,863 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:00,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:00,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:00,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:00,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:00,866 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:00,867 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:00,867 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,867 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:00,867 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:55:00,928 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c9cd81990a644ab6ae6361033c48988d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128c9cd81990a644ab6ae6361033c48988d 2023-11-03 13:55:00,938 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/84177838edf24abe8c771d62bc30828b 2023-11-03 13:55:00,945 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/84177838edf24abe8c771d62bc30828b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b 2023-11-03 13:55:00,956 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:55:00,958 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 91ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:00,959 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:00,959 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:00,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:00,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:00,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:00,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:00,961 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,961 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,961 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,961 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:00,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f38c55[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:00,963 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:00,963 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,964 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:00,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:00,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:00,965 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,965 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:00,966 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:00,966 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,966 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,966 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:00,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:00,969 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:00,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:00,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:00,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,969 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:00,970 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,970 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,971 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:00,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:00,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:00,972 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,973 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:00,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:00,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:00,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:00,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:00,977 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:00,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:00,978 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:00,978 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:00,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:01,078 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:01,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:01,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:01,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:01,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,092 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:01,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:01,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:01,094 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,094 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,097 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,097 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,097 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:01,098 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:01,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:01,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:01,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,103 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:01,103 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,103 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:01,106 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:01,106 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:01,110 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:01,110 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:01,110 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:01,550 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cb49e595c2f3431ea8742e930fde8793 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb49e595c2f3431ea8742e930fde8793 2023-11-03 13:55:01,558 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/2a80226b9f5b4dad8a3372f25f990358 2023-11-03 13:55:01,571 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/2a80226b9f5b4dad8a3372f25f990358 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358 2023-11-03 13:55:01,591 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358, entries=1, sequenceid=13, filesize=4.9 K 2023-11-03 13:55:01,594 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 484ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:01,594 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:01,594 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:01,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:01,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:01,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:01,595 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:01,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,600 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,600 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:01,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46e03f80[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:01,602 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:01,602 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,603 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:01,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:01,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:01,604 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,604 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:01,605 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:01,605 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:01,605 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,605 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:01,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:01,609 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:01,609 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:01,609 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:01,610 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,610 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:01,623 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,623 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,623 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:01,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:01,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:01,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,625 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,627 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:01,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:01,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:01,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:01,635 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:01,635 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:01,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:01,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:01,736 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:01,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:01,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:01,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:01,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,746 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:01,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:01,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:01,751 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,753 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,754 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,754 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:01,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:01,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,762 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:01,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,762 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:01,763 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,763 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:01,763 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:01,763 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:01,763 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:01,763 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:01,763 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:01,811 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056164b9cf9eb44afcac230b0d7bad771c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056164b9cf9eb44afcac230b0d7bad771c 2023-11-03 13:55:01,822 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/31a5c73a461641c396a8038202ccb6cc 2023-11-03 13:55:01,832 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/31a5c73a461641c396a8038202ccb6cc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc 2023-11-03 13:55:01,841 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc, entries=1, sequenceid=17, filesize=4.9 K 2023-11-03 13:55:01,843 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 80ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:01,843 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:01,843 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:01,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:01,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:01,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:01,843 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:01,845 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,845 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,846 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,846 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:01,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:01,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6aff8970[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:01,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:01,848 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,849 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,850 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:01,850 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:01,850 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,850 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:01,850 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:01,851 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,851 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:01,851 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:01,851 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:01,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:01,855 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:01,855 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:01,855 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:01,855 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,855 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:01,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,858 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,858 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:01,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:01,859 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,860 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,863 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:01,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:01,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:01,863 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:01,864 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:01,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:01,864 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:01,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:01,864 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:01,964 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:01,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:01,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:01,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:01,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,975 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:01,975 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,975 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:01,975 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:01,975 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,976 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,978 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:01,978 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,979 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:01,979 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:01,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,980 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,982 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:01,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:01,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:01,983 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:01,983 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:01,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:01,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:01,986 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:01,986 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:01,987 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:02,010 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288c2ae152da544b74bd89d51429ebf7f9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288c2ae152da544b74bd89d51429ebf7f9 2023-11-03 13:55:02,025 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/3e1789041dfd49febb5e5372c0f9c772 2023-11-03 13:55:02,032 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/3e1789041dfd49febb5e5372c0f9c772 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772 2023-11-03 13:55:02,041 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772, entries=1, sequenceid=21, filesize=4.9 K 2023-11-03 13:55:02,043 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 56ms, sequenceid=21, compaction requested=true 2023-11-03 13:55:02,043 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:02,043 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:02,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:02,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:02,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:02,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:02,045 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,045 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,046 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,046 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:02,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17fc8edc[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:02,049 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:02,049 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,051 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:02,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:02,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:02,052 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,052 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:02,052 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:02,052 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,052 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:02,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:02,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:02,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:02,055 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:02,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:02,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:02,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,056 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:02,066 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,066 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,066 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,067 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,069 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,075 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,075 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:02,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:02,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:02,076 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:02,076 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:02,176 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:02,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:02,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:02,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:02,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,185 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:02,185 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:02,185 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:02,185 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:02,185 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,185 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,186 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,186 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:02,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:02,187 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,187 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:02,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:02,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,189 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,190 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:02,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,190 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:02,191 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:02,191 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:02,194 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:02,194 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:02,194 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:02,194 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:02,195 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:02,219 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f840dfb198564c6d80db97a590ca3487 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f840dfb198564c6d80db97a590ca3487 2023-11-03 13:55:02,226 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/63ce0dccef0b4ce683529faf1977992b 2023-11-03 13:55:02,236 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/63ce0dccef0b4ce683529faf1977992b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b 2023-11-03 13:55:02,242 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b, entries=1, sequenceid=25, filesize=4.9 K 2023-11-03 13:55:02,243 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 48ms, sequenceid=25, compaction requested=true 2023-11-03 13:55:02,243 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:02,243 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:02,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:02,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:02,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:02,244 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:02,245 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,245 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,245 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,245 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f952952[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:02,247 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:02,247 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,248 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,248 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:02,248 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:02,248 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:02,248 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,248 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:02,249 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,249 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:02,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,249 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:02,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,249 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:02,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:02,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:02,252 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:02,252 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:02,252 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:02,252 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,252 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:02,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,254 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:02,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:02,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:02,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,255 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,256 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:02,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:02,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:02,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,266 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,266 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:02,267 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,267 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:02,267 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:02,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:02,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:02,367 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:02,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:02,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:02,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:02,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,373 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:02,373 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:02,373 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:02,373 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:02,374 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,374 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,375 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:02,375 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:02,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:02,375 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:02,375 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:02,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,376 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:02,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:02,376 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:02,376 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:02,376 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:02,377 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:02,377 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:02,377 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:02,377 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:02,377 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:02,635 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:55:02,673 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:02,673 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x781f4862 to 127.0.0.1:53668 2023-11-03 13:55:02,674 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:02,678 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:02,678 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b2cd55c to 127.0.0.1:53668 2023-11-03 13:55:02,679 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:02,679 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:02,679 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7738e060 to 127.0.0.1:53668 2023-11-03 13:55:02,679 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:02,679 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:02,680 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55ceefc5 to 127.0.0.1:53668 2023-11-03 13:55:02,680 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:02,790 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014b6900ba854b48b48adc3d9f03225de3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014b6900ba854b48b48adc3d9f03225de3 2023-11-03 13:55:03,197 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/b6e976ed5ed3461c898de3c73b8f0209 2023-11-03 13:55:03,203 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/b6e976ed5ed3461c898de3c73b8f0209 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209 2023-11-03 13:55:03,208 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209, entries=1, sequenceid=29, filesize=4.9 K 2023-11-03 13:55:03,209 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 832ms, sequenceid=29, compaction requested=true 2023-11-03 13:55:03,209 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:03,209 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:03,209 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:03,209 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:03,209 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,209 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:03,209 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:03,211 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,211 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,211 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,211 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:03,213 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:03,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28ce071f[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:03,213 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,214 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:03,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:03,214 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,214 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:03,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:03,215 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:03,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:03,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:03,219 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:03,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:03,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:03,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,219 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:03,221 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,221 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,221 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,223 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:03,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:03,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:03,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:03,226 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,226 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,227 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,227 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:03,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:03,227 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:03,227 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:03,327 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:03,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:03,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:03,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:03,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,334 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:03,334 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:03,334 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:03,334 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:03,335 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,335 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,336 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:03,336 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:03,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:03,336 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,336 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,337 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,338 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:03,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,338 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:03,338 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:03,338 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:03,338 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:03,338 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:03,338 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:03,339 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:03,339 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:03,759 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010394348fbb825a4e6194456ffcc237f91f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010394348fbb825a4e6194456ffcc237f91f 2023-11-03 13:55:03,766 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/4a791c77bd5c43b1964c0a0a124d6d1f 2023-11-03 13:55:03,772 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/4a791c77bd5c43b1964c0a0a124d6d1f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f 2023-11-03 13:55:03,777 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f, entries=1, sequenceid=33, filesize=4.9 K 2023-11-03 13:55:03,778 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 439ms, sequenceid=33, compaction requested=true 2023-11-03 13:55:03,779 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:03,779 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:03,779 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:03,779 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:03,779 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,779 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:03,779 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:03,781 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,781 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,782 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,782 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:03,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e6cbf7f[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:03,783 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:03,783 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,784 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,784 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,784 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:03,784 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:03,784 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:03,784 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:03,786 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,786 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,786 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:03,786 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:03,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:03,789 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:03,789 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:03,789 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:03,789 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,789 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:03,790 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,790 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:03,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,790 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:03,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:03,791 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,792 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,794 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,794 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:03,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:03,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:03,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:03,795 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:03,795 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:03,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:03,895 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:03,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:03,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:03,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:03,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,902 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:03,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:03,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:03,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:03,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,903 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,903 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:03,904 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:03,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:03,904 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:03,904 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:03,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,905 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,905 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:03,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:03,905 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:03,905 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:03,905 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:03,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:03,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:03,910 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:03,910 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:03,910 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:04,333 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075054aba25f00472da548ae18ca29b698 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509075054aba25f00472da548ae18ca29b698 2023-11-03 13:55:04,344 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/0f2fc42788b84dc283fb758e983e14ad 2023-11-03 13:55:04,350 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/0f2fc42788b84dc283fb758e983e14ad as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad 2023-11-03 13:55:04,356 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad, entries=1, sequenceid=37, filesize=4.9 K 2023-11-03 13:55:04,357 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 447ms, sequenceid=37, compaction requested=true 2023-11-03 13:55:04,357 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:04,357 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:04,357 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:04,357 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:04,357 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,358 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:04,358 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:04,359 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,359 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:04,359 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:04,359 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d955c00[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:04,360 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:04,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,361 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:04,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:04,361 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:04,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,362 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:04,362 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,362 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:04,362 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:04,363 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:04,379 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:04,379 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:04,379 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:04,379 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,379 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:04,381 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,381 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:04,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:04,382 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,382 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:04,384 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:04,387 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:04,387 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,387 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:04,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:04,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:04,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:04,387 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:04,387 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:04,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:04,487 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:04,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:04,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:04,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:04,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,494 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:04,494 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:04,494 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-03 13:55:04,494 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-03 13:55:04,494 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,495 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,496 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:04,496 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:04,496 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:04,496 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-03 13:55:04,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:04,497 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-03 13:55:04,497 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:04,497 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-03 13:55:04,497 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:04,497 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:04,497 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:04,497 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. started... 2023-11-03 13:55:04,497 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9698b8a3cd29c99df62020ad84c00ed5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:04,912 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d78c56aa18354d6989285c35d20e3449 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120d78c56aa18354d6989285c35d20e3449 2023-11-03 13:55:05,318 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/f379bc477ad347d8902eee9d6805c436 2023-11-03 13:55:05,323 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/f379bc477ad347d8902eee9d6805c436 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436 2023-11-03 13:55:05,328 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436, entries=1, sequenceid=41, filesize=4.9 K 2023-11-03 13:55:05,329 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9698b8a3cd29c99df62020ad84c00ed5 in 832ms, sequenceid=41, compaction requested=true 2023-11-03 13:55:05,330 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:05,330 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-03 13:55:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-03 13:55:05,331 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,331 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:05,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-03 13:55:05,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b8c3359[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:05,333 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-03 13:55:05,333 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,334 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-03 13:55:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-03 13:55:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:05,335 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-03 13:55:05,336 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:05,336 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:05,339 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:05,339 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,339 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:05,341 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,341 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:05,341 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:05,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,342 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,343 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:05,346 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:05,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-03 13:55:05,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-03 13:55:05,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:05,346 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:05,347 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:05,347 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:05,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:05,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:05,447 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:05,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:05,450 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-03 13:55:05,452 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:55:05,453 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:55:05,454 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020305454 2023-11-03 13:55:05,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:05,455 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:05,456 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-03 13:55:05,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:05,459 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x010b1b89 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:05,473 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d5a31b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:05,474 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:05,967 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103589b17c2fa514c50918791bf1094252a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103589b17c2fa514c50918791bf1094252a 2023-11-03 13:55:05,969 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:05,996 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:05,998 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:06,012 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:06,013 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:06,042 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eb44ad77c3ee4658ae6d27d6a99c0226 first=Optional[r3] last=Optional[r6] 2023-11-03 13:55:06,047 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eb44ad77c3ee4658ae6d27d6a99c0226}] 2023-11-03 13:55:06,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eb44ad77c3ee4658ae6d27d6a99c0226 for inclusion in 9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-03 13:55:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:06,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:06,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eb44ad77c3ee4658ae6d27d6a99c0226 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j38p82vgh4de6lgtao4bshda0ck74hq7r7j75068sjm89ktmoann1guf6vhftuu/family1/eb44ad77c3ee4658ae6d27d6a99c0226 2023-11-03 13:55:06,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j38p82vgh4de6lgtao4bshda0ck74hq7r7j75068sjm89ktmoann1guf6vhftuu/family1/eb44ad77c3ee4658ae6d27d6a99c0226 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_ 2023-11-03 13:55:06,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j38p82vgh4de6lgtao4bshda0ck74hq7r7j75068sjm89ktmoann1guf6vhftuu/family1/eb44ad77c3ee4658ae6d27d6a99c0226 into 9698b8a3cd29c99df62020ad84c00ed5/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_ - updating store file list. 2023-11-03 13:55:06,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_ into 9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:06,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j38p82vgh4de6lgtao4bshda0ck74hq7r7j75068sjm89ktmoann1guf6vhftuu/family1/eb44ad77c3ee4658ae6d27d6a99c0226 into 9698b8a3cd29c99df62020ad84c00ed5/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_) 2023-11-03 13:55:06,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j38p82vgh4de6lgtao4bshda0ck74hq7r7j75068sjm89ktmoann1guf6vhftuu/family1/eb44ad77c3ee4658ae6d27d6a99c0226 2023-11-03 13:55:06,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:55:06,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:55:06,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): 9698b8a3cd29c99df62020ad84c00ed5/family1 is initiating minor compaction 2023-11-03 13:55:06,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43f6d085; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:06,095 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9698b8a3cd29c99df62020ad84c00ed5/family1 in testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:06,095 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp, totalSize=50.0 K 2023-11-03 13:55:06,095 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 84177838edf24abe8c771d62bc30828b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 2a80226b9f5b4dad8a3372f25f990358, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 31a5c73a461641c396a8038202ccb6cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 3e1789041dfd49febb5e5372c0f9c772, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 63ce0dccef0b4ce683529faf1977992b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting b6e976ed5ed3461c898de3c73b8f0209, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 4a791c77bd5c43b1964c0a0a124d6d1f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 0f2fc42788b84dc283fb758e983e14ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting f379bc477ad347d8902eee9d6805c436, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:55:06,096 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:55:06,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:06,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:06,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288c2ae152da544b74bd89d51429ebf7f9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512288c2ae152da544b74bd89d51429ebf7f9 2023-11-03 13:55:06,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f840dfb198564c6d80db97a590ca3487 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f840dfb198564c6d80db97a590ca3487 2023-11-03 13:55:06,133 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014b6900ba854b48b48adc3d9f03225de3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014b6900ba854b48b48adc3d9f03225de3 2023-11-03 13:55:06,143 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010394348fbb825a4e6194456ffcc237f91f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010394348fbb825a4e6194456ffcc237f91f 2023-11-03 13:55:06,143 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-03 13:55:06,143 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,219 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9698b8a3cd29c99df62020ad84c00ed5#family1#compaction#48 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:06,656 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/a1096dc87fd14cb0a4a8526bc5c43cce as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/a1096dc87fd14cb0a4a8526bc5c43cce 2023-11-03 13:55:06,658 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058c38738412b14505b9614090d73c5cda to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058c38738412b14505b9614090d73c5cda 2023-11-03 13:55:06,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:06,664 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9698b8a3cd29c99df62020ad84c00ed5/family1 of 9698b8a3cd29c99df62020ad84c00ed5 into a1096dc87fd14cb0a4a8526bc5c43cce(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:06,664 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:06,664 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699019706095; duration=0sec 2023-11-03 13:55:06,664 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:06,690 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48ad15308bbd468481ddf655716731b8 first=Optional[r00] last=Optional[r2] 2023-11-03 13:55:06,691 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48ad15308bbd468481ddf655716731b8}] 2023-11-03 13:55:06,695 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48ad15308bbd468481ddf655716731b8 for inclusion in 9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:06,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-03 13:55:06,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:06,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:06,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48ad15308bbd468481ddf655716731b8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hvacd1hg8pe9sbqiogvqkmngdrmdkfegk12fd3l41iqciodpmt10rpuvqb9e1gt3/family1/48ad15308bbd468481ddf655716731b8 2023-11-03 13:55:06,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hvacd1hg8pe9sbqiogvqkmngdrmdkfegk12fd3l41iqciodpmt10rpuvqb9e1gt3/family1/48ad15308bbd468481ddf655716731b8 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_ 2023-11-03 13:55:06,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hvacd1hg8pe9sbqiogvqkmngdrmdkfegk12fd3l41iqciodpmt10rpuvqb9e1gt3/family1/48ad15308bbd468481ddf655716731b8 into 9698b8a3cd29c99df62020ad84c00ed5/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_ - updating store file list. 2023-11-03 13:55:06,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_ into 9698b8a3cd29c99df62020ad84c00ed5/family1 2023-11-03 13:55:06,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hvacd1hg8pe9sbqiogvqkmngdrmdkfegk12fd3l41iqciodpmt10rpuvqb9e1gt3/family1/48ad15308bbd468481ddf655716731b8 into 9698b8a3cd29c99df62020ad84c00ed5/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_) 2023-11-03 13:55:06,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hvacd1hg8pe9sbqiogvqkmngdrmdkfegk12fd3l41iqciodpmt10rpuvqb9e1gt3/family1/48ad15308bbd468481ddf655716731b8 2023-11-03 13:55:06,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:55:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:55:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): 9698b8a3cd29c99df62020ad84c00ed5/family1 is initiating minor compaction (all files) 2023-11-03 13:55:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4799418f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:06,712 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9698b8a3cd29c99df62020ad84c00ed5/family1 in testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:55:06,712 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/a1096dc87fd14cb0a4a8526bc5c43cce, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp, totalSize=337.0 K 2023-11-03 13:55:06,713 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting d209865463ca428b986fb81a588c8347, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:55:06,713 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting a1096dc87fd14cb0a4a8526bc5c43cce, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:55:06,714 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878817029 2023-11-03 13:55:06,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:06,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:06,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130077e6d883b744cc8b27b418a1626beea to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130077e6d883b744cc8b27b418a1626beea 2023-11-03 13:55:06,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb49e595c2f3431ea8742e930fde8793 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb49e595c2f3431ea8742e930fde8793 2023-11-03 13:55:06,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056164b9cf9eb44afcac230b0d7bad771c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056164b9cf9eb44afcac230b0d7bad771c 2023-11-03 13:55:06,722 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-03 13:55:06,722 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-03 13:55:06,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-03 13:55:06,723 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-03 13:55:06,723 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:06,724 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:55:06,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.2740 sec 2023-11-03 13:55:06,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_] to archive 2023-11-03 13:55:06,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:06,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/84177838edf24abe8c771d62bc30828b 2023-11-03 13:55:06,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/2a80226b9f5b4dad8a3372f25f990358 2023-11-03 13:55:06,747 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9698b8a3cd29c99df62020ad84c00ed5#family1#compaction#49 average throughput is 7.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:06,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/31a5c73a461641c396a8038202ccb6cc 2023-11-03 13:55:06,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/3e1789041dfd49febb5e5372c0f9c772 2023-11-03 13:55:06,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/63ce0dccef0b4ce683529faf1977992b 2023-11-03 13:55:06,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/b6e976ed5ed3461c898de3c73b8f0209 2023-11-03 13:55:06,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4a791c77bd5c43b1964c0a0a124d6d1f 2023-11-03 13:55:06,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/0f2fc42788b84dc283fb758e983e14ad 2023-11-03 13:55:06,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/f379bc477ad347d8902eee9d6805c436 2023-11-03 13:55:06,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/25e96f13e7fc429f8014fcb4d691a5e7_SeqId_44_ 2023-11-03 13:55:06,786 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/.tmp/family1/ba451d44d9c347afa8d134b9f7e29429 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/ba451d44d9c347afa8d134b9f7e29429 2023-11-03 13:55:06,800 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9698b8a3cd29c99df62020ad84c00ed5/family1 of 9698b8a3cd29c99df62020ad84c00ed5 into ba451d44d9c347afa8d134b9f7e29429(size=166.8 K), total size for store is 166.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:06,800 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:55:06,800 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1699019706712; duration=0sec 2023-11-03 13:55:06,800 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:06,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/a1096dc87fd14cb0a4a8526bc5c43cce, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_] to archive 2023-11-03 13:55:06,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:06,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/d209865463ca428b986fb81a588c8347 2023-11-03 13:55:06,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/a1096dc87fd14cb0a4a8526bc5c43cce to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/a1096dc87fd14cb0a4a8526bc5c43cce 2023-11-03 13:55:06,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/family1/4162cbe8aeea44cfa3633c286b2ed9d6_SeqId_47_ 2023-11-03 13:55:06,870 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 264), OpenFileDescriptor=638 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1400 (was 1478), ProcessCount=191 (was 191), AvailableMemoryMB=1851 (was 394) - AvailableMemoryMB LEAK? - 2023-11-03 13:55:06,884 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=1400, ProcessCount=191, AvailableMemoryMB=1848 2023-11-03 13:55:06,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:55:06,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:06,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:55:06,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-03 13:55:06,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:55:06,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:06,891 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:06,891 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 empty. 2023-11-03 13:55:06,892 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:06,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-03 13:55:06,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:07,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:07,300 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:07,301 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => a914db93780e65775c574379b67493d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:07,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:07,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:07,707 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing a914db93780e65775c574379b67493d2, disabling compactions & flushes 2023-11-03 13:55:07,707 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:07,708 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:07,708 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. after waiting 0 ms 2023-11-03 13:55:07,708 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:07,708 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:07,708 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:07,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:55:07,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019707712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019707712"}]},"ts":"1699019707712"} 2023-11-03 13:55:07,715 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:55:07,716 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:55:07,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019707716"}]},"ts":"1699019707716"} 2023-11-03 13:55:07,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-03 13:55:07,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, ASSIGN}] 2023-11-03 13:55:07,724 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, ASSIGN 2023-11-03 13:55:07,725 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:07,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:07,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019707880"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019707880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019707880"}]},"ts":"1699019707880"} 2023-11-03 13:55:07,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:08,037 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:08,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:08,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a914db93780e65775c574379b67493d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:08,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:08,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,044 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,058 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:08,059 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:08,059 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a914db93780e65775c574379b67493d2 columnFamilyName family1 2023-11-03 13:55:08,071 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(310): Store=a914db93780e65775c574379b67493d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:08,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a914db93780e65775c574379b67493d2 2023-11-03 13:55:08,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:08,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a914db93780e65775c574379b67493d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73442460, jitterRate=0.09437793493270874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:08,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:08,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., pid=41, masterSystemTime=1699019708037 2023-11-03 13:55:08,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:08,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:08,101 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:08,102 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019708101"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019708101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019708101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019708101"}]},"ts":"1699019708101"} 2023-11-03 13:55:08,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-03 13:55:08,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 220 msec 2023-11-03 13:55:08,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-03 13:55:08,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, ASSIGN in 384 msec 2023-11-03 13:55:08,107 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:55:08,107 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019708107"}]},"ts":"1699019708107"} 2023-11-03 13:55:08,109 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-03 13:55:08,113 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:55:08,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2270 sec 2023-11-03 13:55:08,700 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:08,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-03 13:55:08,997 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-03 13:55:09,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,047 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:09,047 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,048 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:09,048 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:09,050 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,050 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,054 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:09,059 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:09,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,090 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:09,090 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,090 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:09,091 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:09,091 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:09,091 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:09,091 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:09,092 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:55:09,183 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307410105b4ba54f6e9eb278eca94ec619 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511307410105b4ba54f6e9eb278eca94ec619 2023-11-03 13:55:09,196 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/3b5b8e63244041b0b26ebe86e28d3ebb 2023-11-03 13:55:09,204 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/3b5b8e63244041b0b26ebe86e28d3ebb as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb 2023-11-03 13:55:09,210 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-03 13:55:09,211 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 118ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:09,215 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:09,215 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:09,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:09,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:09,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:09,215 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:09,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,217 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:09,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53222bc8[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:09,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:09,219 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,220 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,220 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:09,220 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:09,220 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:09,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,222 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:09,223 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:09,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:09,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,223 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:09,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:09,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:09,225 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:09,225 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:09,225 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:09,225 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,225 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:09,227 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,227 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,227 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,228 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,230 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,240 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,240 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:09,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:09,241 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:09,241 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:09,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-03 13:55:09,341 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:09,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:09,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:09,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:09,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,358 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:09,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:09,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:09,359 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,359 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:09,362 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:09,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,368 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:09,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:09,370 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:09,370 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:09,370 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:09,370 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:09,371 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:55:09,397 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b3b0560e266e4beb8aab27074e374b46 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b3b0560e266e4beb8aab27074e374b46 2023-11-03 13:55:09,808 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/eabdcbcc55e8408ca633bac7f2b9ec03 2023-11-03 13:55:09,815 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/eabdcbcc55e8408ca633bac7f2b9ec03 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03 2023-11-03 13:55:09,821 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:55:09,822 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 451ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:09,823 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:09,823 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:09,824 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,825 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,825 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:09,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8eee194[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:09,826 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:09,826 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,827 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:09,828 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:09,828 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,828 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:09,829 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,829 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:09,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,829 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:09,829 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:09,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:09,832 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:09,832 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:09,832 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:09,832 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,832 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:09,833 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,833 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,833 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:09,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:09,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:09,834 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,835 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:09,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:09,841 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:09,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:09,841 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:09,942 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:09,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:09,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,948 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:09,948 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,948 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:09,948 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:09,949 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,949 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,949 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:09,949 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:09,950 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:09,950 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:09,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:09,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:09,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:09,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:09,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:09,951 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:09,951 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:09,951 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:09,951 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:09,964 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120116113ccf6f99407d8ffd33a9289883c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120116113ccf6f99407d8ffd33a9289883c0 2023-11-03 13:55:10,369 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ab94024a5bed4fad94ecb937afcb17fd 2023-11-03 13:55:10,382 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ab94024a5bed4fad94ecb937afcb17fd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd 2023-11-03 13:55:10,387 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd, entries=1, sequenceid=13, filesize=5.0 K 2023-11-03 13:55:10,388 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 437ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:10,388 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:10,388 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:10,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:10,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:10,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:10,388 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:10,389 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:10,390 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,390 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:10,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:10,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f7cd9d5[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:10,392 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:10,392 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,393 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,393 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:10,393 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:10,393 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:10,393 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,393 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:10,394 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:10,395 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:10,395 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:10,395 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:10,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:10,398 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:10,398 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:10,398 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:10,398 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,398 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:10,399 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,399 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:10,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,399 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:10,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:10,400 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:10,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,401 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:10,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,403 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:10,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:10,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:10,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:10,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:10,404 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:10,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-03 13:55:10,404 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:10,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:10,504 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:10,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:10,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:10,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:10,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,512 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:10,512 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:10,512 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:10,512 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:10,513 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,513 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,514 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:10,514 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,515 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:10,515 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,522 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:10,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:10,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:10,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:10,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:10,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:10,523 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:10,524 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:10,524 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:10,524 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:10,974 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205014efa6b6a0a48c7868f68febe18076c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205014efa6b6a0a48c7868f68febe18076c 2023-11-03 13:55:10,987 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/094ad6f4b049473aa8c404d23aab76e1 2023-11-03 13:55:11,001 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/094ad6f4b049473aa8c404d23aab76e1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1 2023-11-03 13:55:11,018 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1, entries=1, sequenceid=17, filesize=5.0 K 2023-11-03 13:55:11,024 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 500ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:11,025 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:11,025 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:11,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:11,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:11,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:11,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:11,026 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,026 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,027 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,027 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:11,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5803998[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:11,029 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:11,029 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,030 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:11,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:11,031 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:11,031 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:11,031 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:11,031 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:11,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:11,034 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:11,034 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:11,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:11,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,035 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:11,048 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,048 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:11,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,048 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:11,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:11,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,052 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,066 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:11,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:11,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:11,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:11,071 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:11,071 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:11,172 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:11,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:11,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:11,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:11,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,178 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:11,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:11,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:11,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:11,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,179 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,181 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:11,181 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:11,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:11,181 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,182 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,182 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,182 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:11,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,183 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:11,183 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:11,183 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:11,183 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:11,183 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:11,183 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:11,183 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:11,183 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:11,598 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ff60fa0432ad49ffa5d3ca5b67ab9c6c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff60fa0432ad49ffa5d3ca5b67ab9c6c 2023-11-03 13:55:11,634 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ff816f6184bc4251a6404f889849e6c0 2023-11-03 13:55:11,642 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ff816f6184bc4251a6404f889849e6c0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0 2023-11-03 13:55:11,654 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0, entries=1, sequenceid=21, filesize=5.0 K 2023-11-03 13:55:11,655 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 472ms, sequenceid=21, compaction requested=true 2023-11-03 13:55:11,655 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:11,655 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:11,655 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:11,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:11,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:11,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:11,662 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473e3e8b[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:11,665 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:11,665 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,674 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,674 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:11,674 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:11,674 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:11,675 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,675 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:11,676 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:11,676 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:11,676 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:11,676 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:11,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:11,679 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:11,680 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:11,680 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:11,680 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,680 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:11,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:11,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:11,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,683 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:11,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:11,687 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,691 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:11,691 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:11,691 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,692 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:11,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:11,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:11,693 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:11,693 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:11,793 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:11,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:11,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:11,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:11,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,801 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:11,801 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:11,801 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:11,801 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:11,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,803 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:11,803 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:11,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:11,806 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:11,807 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:11,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,812 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,812 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:11,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:11,812 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:11,812 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:11,812 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:11,812 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:11,812 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:11,812 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:11,812 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:11,813 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:12,247 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231976ad89647184ac5bdbf5116f79b2244 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231976ad89647184ac5bdbf5116f79b2244 2023-11-03 13:55:12,258 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd 2023-11-03 13:55:12,266 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd 2023-11-03 13:55:12,274 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd, entries=1, sequenceid=25, filesize=5.0 K 2023-11-03 13:55:12,277 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 464ms, sequenceid=25, compaction requested=true 2023-11-03 13:55:12,277 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:12,277 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:12,277 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:12,277 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:12,277 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,277 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:12,277 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:12,279 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,279 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:12,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@382395b9[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:12,281 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:12,281 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,282 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,283 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:12,283 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:12,283 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:12,284 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,284 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:12,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:12,286 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:12,286 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:12,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:12,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:12,289 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:12,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:12,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:12,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,289 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:12,299 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,299 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:12,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,299 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,301 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,302 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-03 13:55:12,307 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:12,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:12,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:12,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:12,307 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,308 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:12,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:12,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:12,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:12,408 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:12,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:12,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:12,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,418 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:12,418 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:12,418 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:12,418 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:12,422 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,422 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,424 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:12,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:12,424 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:12,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,425 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,425 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:12,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:12,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:12,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:12,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:12,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:12,428 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:12,428 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:12,428 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:12,428 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:12,428 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:12,497 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010102d65273fb394bd8a818f23dde27ef5b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010102d65273fb394bd8a818f23dde27ef5b 2023-11-03 13:55:12,908 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/7b13cfa67b974701a3e10446783de009 2023-11-03 13:55:12,915 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/7b13cfa67b974701a3e10446783de009 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009 2023-11-03 13:55:12,922 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009, entries=1, sequenceid=29, filesize=5.0 K 2023-11-03 13:55:12,923 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 495ms, sequenceid=29, compaction requested=true 2023-11-03 13:55:12,923 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:12,923 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:12,923 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:12,923 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:12,923 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,923 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:12,924 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:12,925 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,925 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:12,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31184119[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:12,928 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:12,928 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,930 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,930 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:12,930 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:12,930 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:12,930 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,930 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:12,931 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:12,931 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,931 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,931 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:12,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:12,934 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:12,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:12,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:12,934 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,934 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:12,936 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,937 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:12,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,937 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:12,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,938 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:12,940 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:12,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:12,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:12,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,942 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:12,942 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:12,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:12,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:12,943 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,943 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:12,943 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:12,943 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,043 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:13,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:13,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:13,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:13,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,058 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:13,058 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:13,058 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:13,058 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:13,063 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,063 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,069 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:13,069 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:13,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:13,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:13,086 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:13,086 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:13,086 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:13,190 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ed77bb1920124f8daed42121c8ac82ee to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed77bb1920124f8daed42121c8ac82ee 2023-11-03 13:55:13,589 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:55:13,638 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ccbc4aab70124e9993f976c44a1a8768 2023-11-03 13:55:13,667 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/ccbc4aab70124e9993f976c44a1a8768 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768 2023-11-03 13:55:13,679 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768, entries=1, sequenceid=33, filesize=5.0 K 2023-11-03 13:55:13,682 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 596ms, sequenceid=33, compaction requested=true 2023-11-03 13:55:13,683 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:13,683 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:13,684 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:13,684 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:13,684 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,684 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:13,684 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:13,694 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,698 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:13,700 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,700 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:13,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:13,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:13,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d0f25b[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:13,714 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:13,715 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,717 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,717 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:13,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:13,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:13,723 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,723 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:13,730 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:13,730 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:13,730 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:13,730 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:13,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:13,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:13,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:13,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:13,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:13,752 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:13,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:13,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:13,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,752 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:13,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:13,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:13,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:13,754 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:13,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,756 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,760 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:13,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,760 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,761 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:13,761 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:13,761 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:13,761 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:13,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:13,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:13,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-03 13:55:13,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:13,861 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:13,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:13,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:13,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:13,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,870 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:13,870 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:13,870 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:13,870 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:13,874 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,874 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,875 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:13,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:13,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:13,876 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:13,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,880 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:13,880 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:13,882 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:13,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:13,882 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:13,882 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:13,882 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:13,883 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:13,883 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:13,883 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:13,883 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:13,883 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:13,922 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.38461538461538464, tune throughput to 69.23 MB/second 2023-11-03 13:55:14,328 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b96b2e1aa00e4a9ca76dffbbdcaa7b28 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907b96b2e1aa00e4a9ca76dffbbdcaa7b28 2023-11-03 13:55:14,734 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/e6a056f157e645649478ecb5dd4a4182 2023-11-03 13:55:14,739 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/e6a056f157e645649478ecb5dd4a4182 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182 2023-11-03 13:55:14,743 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182, entries=1, sequenceid=37, filesize=5.0 K 2023-11-03 13:55:14,744 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 861ms, sequenceid=37, compaction requested=true 2023-11-03 13:55:14,744 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:14,744 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:14,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:14,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:14,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:14,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:14,745 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,746 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:14,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:14,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ac480c[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:14,747 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:14,748 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,748 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:14,748 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,751 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,751 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:14,751 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:14,751 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:14,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:14,753 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:14,753 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:14,753 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:14,753 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:14,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:14,756 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:14,756 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:14,756 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:14,756 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,756 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:14,758 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,758 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:14,758 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:14,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:14,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:14,759 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,760 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:14,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:14,773 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:14,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:14,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,774 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,774 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,774 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,774 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:14,774 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:14,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:14,874 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:14,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:14,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:14,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:14,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,882 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:14,882 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:14,882 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-03 13:55:14,882 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-03 13:55:14,887 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,887 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,888 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:14,888 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:14,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:14,888 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:14,888 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:14,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:14,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,890 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-03 13:55:14,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:14,890 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-03 13:55:14,890 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:14,890 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-03 13:55:14,894 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:14,894 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:14,894 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:14,894 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. started... 2023-11-03 13:55:14,894 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a914db93780e65775c574379b67493d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:15,325 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207eafe38f733d42cfa9e52e6e0dcf2af1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207eafe38f733d42cfa9e52e6e0dcf2af1 2023-11-03 13:55:15,343 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/f7e7d40f7b7545ab95193b99429f9550 2023-11-03 13:55:15,381 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/f7e7d40f7b7545ab95193b99429f9550 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550 2023-11-03 13:55:15,394 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550, entries=1, sequenceid=41, filesize=5.0 K 2023-11-03 13:55:15,401 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a914db93780e65775c574379b67493d2 in 507ms, sequenceid=41, compaction requested=true 2023-11-03 13:55:15,401 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:15,401 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:15,401 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:15,401 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:15,401 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,401 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-03 13:55:15,401 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-03 13:55:15,403 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,403 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:15,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:15,404 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,404 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:15,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:15,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:15,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:15,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-03 13:55:15,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27869b9d[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:15,409 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-03 13:55:15,409 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,416 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-03 13:55:15,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-03 13:55:15,416 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:15,418 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,418 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:15,418 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,418 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-03 13:55:15,418 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:15,418 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-03 13:55:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:15,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:15,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-03 13:55:15,435 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-03 13:55:15,435 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:15,436 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:15,436 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,436 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:15,443 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:15,443 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,443 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:15,444 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:15,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,445 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,448 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:15,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-03 13:55:15,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:15,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-03 13:55:15,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:15,449 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:15,449 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:15,448 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:15,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:15,549 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:15,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:15,551 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:15,552 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:15,553 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:15,554 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:15,554 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020315554 2023-11-03 13:55:15,556 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:15,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-03 13:55:15,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:15,561 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x1b302c15 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:15,565 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47bb6944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:15,565 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,419 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031731faf0fc7141c4881ce46a06f9a7a4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031731faf0fc7141c4881ce46a06f9a7a4 2023-11-03 13:55:16,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:16,438 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:16,439 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:16,451 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:16,453 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:16,494 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4459d8b9f64fd8b4c6aee65279e2ca first=Optional[r3] last=Optional[r6] 2023-11-03 13:55:16,495 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4459d8b9f64fd8b4c6aee65279e2ca}] 2023-11-03 13:55:16,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4459d8b9f64fd8b4c6aee65279e2ca for inclusion in a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:16,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-03 13:55:16,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:16,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:16,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4459d8b9f64fd8b4c6aee65279e2ca to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8ctm7m1hg0g9cdafh8mtqc4l4augod9kpbbcf61jf8hn735qhu6rb4r540pce06b/family1/de4459d8b9f64fd8b4c6aee65279e2ca 2023-11-03 13:55:16,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8ctm7m1hg0g9cdafh8mtqc4l4augod9kpbbcf61jf8hn735qhu6rb4r540pce06b/family1/de4459d8b9f64fd8b4c6aee65279e2ca as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_ 2023-11-03 13:55:16,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8ctm7m1hg0g9cdafh8mtqc4l4augod9kpbbcf61jf8hn735qhu6rb4r540pce06b/family1/de4459d8b9f64fd8b4c6aee65279e2ca into a914db93780e65775c574379b67493d2/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_ - updating store file list. 2023-11-03 13:55:16,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_ into a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:16,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8ctm7m1hg0g9cdafh8mtqc4l4augod9kpbbcf61jf8hn735qhu6rb4r540pce06b/family1/de4459d8b9f64fd8b4c6aee65279e2ca into a914db93780e65775c574379b67493d2/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_) 2023-11-03 13:55:16,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8ctm7m1hg0g9cdafh8mtqc4l4augod9kpbbcf61jf8hn735qhu6rb4r540pce06b/family1/de4459d8b9f64fd8b4c6aee65279e2ca 2023-11-03 13:55:16,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:55:16,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:55:16,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): a914db93780e65775c574379b67493d2/family1 is initiating minor compaction 2023-11-03 13:55:16,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a84a56a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:16,550 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a914db93780e65775c574379b67493d2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:16,550 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp, totalSize=50.4 K 2023-11-03 13:55:16,550 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting eabdcbcc55e8408ca633bac7f2b9ec03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:55:16,550 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting ab94024a5bed4fad94ecb937afcb17fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:55:16,550 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 094ad6f4b049473aa8c404d23aab76e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting ff816f6184bc4251a6404f889849e6c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 26b6f047a22e4ca0aa7e7f249ccb0fbd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 7b13cfa67b974701a3e10446783de009, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting ccbc4aab70124e9993f976c44a1a8768, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting e6a056f157e645649478ecb5dd4a4182, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting f7e7d40f7b7545ab95193b99429f9550, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:55:16,551 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:55:16,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:16,557 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:16,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff60fa0432ad49ffa5d3ca5b67ab9c6c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff60fa0432ad49ffa5d3ca5b67ab9c6c 2023-11-03 13:55:16,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231976ad89647184ac5bdbf5116f79b2244 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231976ad89647184ac5bdbf5116f79b2244 2023-11-03 13:55:16,569 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010102d65273fb394bd8a818f23dde27ef5b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010102d65273fb394bd8a818f23dde27ef5b 2023-11-03 13:55:16,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed77bb1920124f8daed42121c8ac82ee to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed77bb1920124f8daed42121c8ac82ee 2023-11-03 13:55:16,570 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-03 13:55:16,570 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-03 13:55:16,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:16,620 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): a914db93780e65775c574379b67493d2#family1#compaction#60 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:55:17,053 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/04febdc3ae0b40cf97cc801bb514e26a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/04febdc3ae0b40cf97cc801bb514e26a 2023-11-03 13:55:17,064 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e17b0aacd1c24256937075998517ae09 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205e17b0aacd1c24256937075998517ae09 2023-11-03 13:55:17,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:17,066 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a914db93780e65775c574379b67493d2/family1 of a914db93780e65775c574379b67493d2 into 04febdc3ae0b40cf97cc801bb514e26a(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:17,066 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:17,067 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699019716550; duration=0sec 2023-11-03 13:55:17,067 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:17,126 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78e8e370c9334917abc7a4a7fb2bdc99 first=Optional[r00] last=Optional[r2] 2023-11-03 13:55:17,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_] to archive 2023-11-03 13:55:17,130 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78e8e370c9334917abc7a4a7fb2bdc99}] 2023-11-03 13:55:17,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:17,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/eabdcbcc55e8408ca633bac7f2b9ec03 2023-11-03 13:55:17,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ab94024a5bed4fad94ecb937afcb17fd 2023-11-03 13:55:17,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/094ad6f4b049473aa8c404d23aab76e1 2023-11-03 13:55:17,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78e8e370c9334917abc7a4a7fb2bdc99 for inclusion in a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:17,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ff816f6184bc4251a6404f889849e6c0 2023-11-03 13:55:17,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/26b6f047a22e4ca0aa7e7f249ccb0fbd 2023-11-03 13:55:17,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/7b13cfa67b974701a3e10446783de009 2023-11-03 13:55:17,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/ccbc4aab70124e9993f976c44a1a8768 2023-11-03 13:55:17,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-03 13:55:17,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:17,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:17,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78e8e370c9334917abc7a4a7fb2bdc99 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5crdl02c6hiatsof169a262n324cc6i932mbsbqljo3kcijge061smb4nn9l8id7/family1/78e8e370c9334917abc7a4a7fb2bdc99 2023-11-03 13:55:17,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/e6a056f157e645649478ecb5dd4a4182 2023-11-03 13:55:17,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f7e7d40f7b7545ab95193b99429f9550 2023-11-03 13:55:17,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5crdl02c6hiatsof169a262n324cc6i932mbsbqljo3kcijge061smb4nn9l8id7/family1/78e8e370c9334917abc7a4a7fb2bdc99 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_ 2023-11-03 13:55:17,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5crdl02c6hiatsof169a262n324cc6i932mbsbqljo3kcijge061smb4nn9l8id7/family1/78e8e370c9334917abc7a4a7fb2bdc99 into a914db93780e65775c574379b67493d2/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_ - updating store file list. 2023-11-03 13:55:17,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/57e97bb09d6c44e5863ff5674d6b27ca_SeqId_44_ 2023-11-03 13:55:17,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_ into a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:17,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5crdl02c6hiatsof169a262n324cc6i932mbsbqljo3kcijge061smb4nn9l8id7/family1/78e8e370c9334917abc7a4a7fb2bdc99 into a914db93780e65775c574379b67493d2/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_) 2023-11-03 13:55:17,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5crdl02c6hiatsof169a262n324cc6i932mbsbqljo3kcijge061smb4nn9l8id7/family1/78e8e370c9334917abc7a4a7fb2bdc99 2023-11-03 13:55:17,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:55:17,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:55:17,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): a914db93780e65775c574379b67493d2/family1 is initiating minor compaction (all files) 2023-11-03 13:55:17,183 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a914db93780e65775c574379b67493d2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,184 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/04febdc3ae0b40cf97cc801bb514e26a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp, totalSize=390.1 K 2023-11-03 13:55:17,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@e56e562; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:17,187 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 3b5b8e63244041b0b26ebe86e28d3ebb, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:55:17,194 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 04febdc3ae0b40cf97cc801bb514e26a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:55:17,195 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878817029 2023-11-03 13:55:17,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:17,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:17,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511307410105b4ba54f6e9eb278eca94ec619 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511307410105b4ba54f6e9eb278eca94ec619 2023-11-03 13:55:17,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120116113ccf6f99407d8ffd33a9289883c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120116113ccf6f99407d8ffd33a9289883c0 2023-11-03 13:55:17,212 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205014efa6b6a0a48c7868f68febe18076c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205014efa6b6a0a48c7868f68febe18076c 2023-11-03 13:55:17,212 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-03 13:55:17,212 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-03 13:55:17,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:17,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:17,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:17,215 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:17,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.6640 sec 2023-11-03 13:55:17,246 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): a914db93780e65775c574379b67493d2#family1#compaction#61 average throughput is 11.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:55:17,323 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/.tmp/family1/69c15240c74f4e1b983a343fb5ef65e5 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/69c15240c74f4e1b983a343fb5ef65e5 2023-11-03 13:55:17,333 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a914db93780e65775c574379b67493d2/family1 of a914db93780e65775c574379b67493d2 into 69c15240c74f4e1b983a343fb5ef65e5(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:17,334 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:17,334 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699019717183; duration=0sec 2023-11-03 13:55:17,334 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:17,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/04febdc3ae0b40cf97cc801bb514e26a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_] to archive 2023-11-03 13:55:17,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:17,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/3b5b8e63244041b0b26ebe86e28d3ebb 2023-11-03 13:55:17,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/04febdc3ae0b40cf97cc801bb514e26a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/04febdc3ae0b40cf97cc801bb514e26a 2023-11-03 13:55:17,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/c9fccc31a76c4d4ba1ed574928f19274_SeqId_47_ 2023-11-03 13:55:17,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-03 13:55:17,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:17,412 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:17,413 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:17,413 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:17,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-03 13:55:17,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE}] 2023-11-03 13:55:17,420 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE 2023-11-03 13:55:17,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:17,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019717421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019717421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019717421"}]},"ts":"1699019717421"} 2023-11-03 13:55:17,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:17,596 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:17,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a914db93780e65775c574379b67493d2, disabling compactions & flushes 2023-11-03 13:55:17,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. after waiting 0 ms 2023-11-03 13:55:17,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-03 13:55:17,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:17,604 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a914db93780e65775c574379b67493d2 to self. 2023-11-03 13:55:17,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=CLOSED 2023-11-03 13:55:17,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019717606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019717606"}]},"ts":"1699019717606"} 2023-11-03 13:55:17,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-03 13:55:17,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 172 msec 2023-11-03 13:55:17,610 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=true 2023-11-03 13:55:17,760 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:17,760 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019717760"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019717760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019717760"}]},"ts":"1699019717760"} 2023-11-03 13:55:17,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:17,914 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:17,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a914db93780e65775c574379b67493d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:17,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:17,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,918 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,920 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:17,920 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:17,920 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a914db93780e65775c574379b67493d2 columnFamilyName family1 2023-11-03 13:55:17,925 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/69c15240c74f4e1b983a343fb5ef65e5 2023-11-03 13:55:17,925 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(310): Store=a914db93780e65775c574379b67493d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a914db93780e65775c574379b67493d2 2023-11-03 13:55:17,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a914db93780e65775c574379b67493d2; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59032676, jitterRate=-0.12034457921981812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:17,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:17,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., pid=47, masterSystemTime=1699019717914 2023-11-03 13:55:17,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:17,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:17,935 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019717935"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019717935"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019717935"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019717935"}]},"ts":"1699019717935"} 2023-11-03 13:55:17,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-03 13:55:17,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 174 msec 2023-11-03 13:55:17,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-03 13:55:17,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE in 520 msec 2023-11-03 13:55:17,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-03 13:55:17,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 524 msec 2023-11-03 13:55:17,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 558 msec 2023-11-03 13:55:17,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-03 13:55:17,944 INFO [Listener at localhost/39963] compactions.TestMobCompactor(278): alter status finished 2023-11-03 13:55:17,945 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:17,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:17,947 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:17,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:17,948 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020317948 2023-11-03 13:55:17,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:17,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-03 13:55:17,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:17,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x75d41753 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:17,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6939a1e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:17,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:17,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:17,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:17,969 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:17,969 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:18,804 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a33123a5c99844a59c4c78a8b0bf4bcd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a33123a5c99844a59c4c78a8b0bf4bcd 2023-11-03 13:55:18,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:18,819 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:18,820 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:18,828 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:18,831 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:18,849 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50e1811ec8fe480f8a3f601fe8775545 first=Optional[r05] last=Optional[r8] 2023-11-03 13:55:18,850 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=51 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50e1811ec8fe480f8a3f601fe8775545}] 2023-11-03 13:55:18,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50e1811ec8fe480f8a3f601fe8775545 for inclusion in a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-03 13:55:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50e1811ec8fe480f8a3f601fe8775545 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rt2te8a96sqf27k93srnd8l0tsnmorm8su58bh8uosmibne41oue8e4p9ulg04te/family1/50e1811ec8fe480f8a3f601fe8775545 2023-11-03 13:55:18,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rt2te8a96sqf27k93srnd8l0tsnmorm8su58bh8uosmibne41oue8e4p9ulg04te/family1/50e1811ec8fe480f8a3f601fe8775545 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f18ffcb43a3d4e50a8a3946d68d77726_SeqId_53_ 2023-11-03 13:55:18,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rt2te8a96sqf27k93srnd8l0tsnmorm8su58bh8uosmibne41oue8e4p9ulg04te/family1/50e1811ec8fe480f8a3f601fe8775545 into a914db93780e65775c574379b67493d2/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f18ffcb43a3d4e50a8a3946d68d77726_SeqId_53_ - updating store file list. 2023-11-03 13:55:18,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f18ffcb43a3d4e50a8a3946d68d77726_SeqId_53_ into a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:18,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rt2te8a96sqf27k93srnd8l0tsnmorm8su58bh8uosmibne41oue8e4p9ulg04te/family1/50e1811ec8fe480f8a3f601fe8775545 into a914db93780e65775c574379b67493d2/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f18ffcb43a3d4e50a8a3946d68d77726_SeqId_53_) 2023-11-03 13:55:18,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rt2te8a96sqf27k93srnd8l0tsnmorm8su58bh8uosmibne41oue8e4p9ulg04te/family1/50e1811ec8fe480f8a3f601fe8775545 2023-11-03 13:55:18,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:18,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:18,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207eafe38f733d42cfa9e52e6e0dcf2af1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207eafe38f733d42cfa9e52e6e0dcf2af1 2023-11-03 13:55:18,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b3b0560e266e4beb8aab27074e374b46 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b3b0560e266e4beb8aab27074e374b46 2023-11-03 13:55:18,878 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-03 13:55:18,878 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-03 13:55:18,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:18,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:18,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:18,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:18,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:18,880 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:18,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 934 msec 2023-11-03 13:55:18,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:55:18,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:19,373 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-03 13:55:19,374 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:19,374 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-03 13:55:19,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-03 13:55:19,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE}] 2023-11-03 13:55:19,380 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE 2023-11-03 13:55:19,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:19,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019719381"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019719381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019719381"}]},"ts":"1699019719381"} 2023-11-03 13:55:19,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:19,535 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:19,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a914db93780e65775c574379b67493d2, disabling compactions & flushes 2023-11-03 13:55:19,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. after waiting 0 ms 2023-11-03 13:55:19,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-03 13:55:19,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:19,541 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a914db93780e65775c574379b67493d2 to self. 2023-11-03 13:55:19,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,542 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=CLOSED 2023-11-03 13:55:19,542 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019719542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019719542"}]},"ts":"1699019719542"} 2023-11-03 13:55:19,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-03 13:55:19,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 160 msec 2023-11-03 13:55:19,545 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=true 2023-11-03 13:55:19,696 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:19,696 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019719696"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019719696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019719696"}]},"ts":"1699019719696"} 2023-11-03 13:55:19,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:19,849 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:19,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a914db93780e65775c574379b67493d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,854 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,854 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:19,855 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1 2023-11-03 13:55:19,855 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a914db93780e65775c574379b67493d2 columnFamilyName family1 2023-11-03 13:55:19,860 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/69c15240c74f4e1b983a343fb5ef65e5 2023-11-03 13:55:19,864 DEBUG [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/family1/f18ffcb43a3d4e50a8a3946d68d77726_SeqId_53_ 2023-11-03 13:55:19,864 INFO [StoreOpener-a914db93780e65775c574379b67493d2-1] regionserver.HStore(310): Store=a914db93780e65775c574379b67493d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:19,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a914db93780e65775c574379b67493d2 2023-11-03 13:55:19,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a914db93780e65775c574379b67493d2; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63158147, jitterRate=-0.05887027084827423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:19,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:55:19,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2., pid=53, masterSystemTime=1699019719849 2023-11-03 13:55:19,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:55:19,872 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a914db93780e65775c574379b67493d2, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:19,872 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699019719872"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019719872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019719872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019719872"}]},"ts":"1699019719872"} 2023-11-03 13:55:19,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-03 13:55:19,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure a914db93780e65775c574379b67493d2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 175 msec 2023-11-03 13:55:19,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-03 13:55:19,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a914db93780e65775c574379b67493d2, REOPEN/MOVE in 496 msec 2023-11-03 13:55:19,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-03 13:55:19,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 500 msec 2023-11-03 13:55:19,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 920 msec 2023-11-03 13:55:19,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-03 13:55:19,885 INFO [Listener at localhost/39963] compactions.TestMobCompactor(278): alter status finished 2023-11-03 13:55:19,886 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-03 13:55:19,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:19,889 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:19,891 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020319891 2023-11-03 13:55:19,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:19,892 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:19,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-03 13:55:19,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:19,895 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x65dd49ca to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:19,903 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@414ff214, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:19,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,904 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,904 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,904 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-03 13:55:19,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-03 13:55:19,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:19,906 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-03 13:55:19,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 19 msec 2023-11-03 13:55:19,960 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=252 (was 251) - Thread LEAK? -, OpenFileDescriptor=648 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1213 (was 1400), ProcessCount=193 (was 191) - ProcessCount LEAK? -, AvailableMemoryMB=2345 (was 1848) - AvailableMemoryMB LEAK? - 2023-11-03 13:55:19,972 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=252, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=1213, ProcessCount=193, AvailableMemoryMB=2343 2023-11-03 13:55:19,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-03 13:55:19,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:19,977 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:55:19,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-03 13:55:19,978 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:55:19,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-03 13:55:19,979 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:19,980 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee empty. 2023-11-03 13:55:19,981 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:19,981 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-03 13:55:19,995 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:19,998 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9ff818d7ca8c39b008fd99234a4e0bee, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:20,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-03 13:55:20,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 9ff818d7ca8c39b008fd99234a4e0bee, disabling compactions & flushes 2023-11-03 13:55:20,404 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. after waiting 0 ms 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,404 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:20,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:55:20,408 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019720408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019720408"}]},"ts":"1699019720408"} 2023-11-03 13:55:20,410 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:55:20,411 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:55:20,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019720411"}]},"ts":"1699019720411"} 2023-11-03 13:55:20,413 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-03 13:55:20,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, ASSIGN}] 2023-11-03 13:55:20,418 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, ASSIGN 2023-11-03 13:55:20,419 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:20,570 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:20,570 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019720570"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019720570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019720570"}]},"ts":"1699019720570"} 2023-11-03 13:55:20,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:20,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-03 13:55:20,724 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:20,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ff818d7ca8c39b008fd99234a4e0bee, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:20,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:20,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,729 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,731 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:20,731 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:20,731 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff818d7ca8c39b008fd99234a4e0bee columnFamilyName family1 2023-11-03 13:55:20,733 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(310): Store=9ff818d7ca8c39b008fd99234a4e0bee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:20,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:20,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:20,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9ff818d7ca8c39b008fd99234a4e0bee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61149944, jitterRate=-0.08879482746124268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:20,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:20,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., pid=57, masterSystemTime=1699019720723 2023-11-03 13:55:20,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:20,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:20,745 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019720745"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019720745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019720745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019720745"}]},"ts":"1699019720745"} 2023-11-03 13:55:20,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-03 13:55:20,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288 in 174 msec 2023-11-03 13:55:20,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-03 13:55:20,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, ASSIGN in 332 msec 2023-11-03 13:55:20,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:55:20,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019720756"}]},"ts":"1699019720756"} 2023-11-03 13:55:20,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-03 13:55:20,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:55:20,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 786 msec 2023-11-03 13:55:21,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-03 13:55:21,084 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-03 13:55:21,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:21,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,134 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:21,134 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:21,134 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:21,134 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:21,135 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,135 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,136 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,136 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:21,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:21,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:21,136 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,136 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:21,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,137 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:21,137 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:21,137 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:21,138 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:21,138 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:21,138 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:21,138 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:21,139 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:55:21,564 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e228fb729fab4746b6e973d00bd61a1d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e228fb729fab4746b6e973d00bd61a1d 2023-11-03 13:55:21,968 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0 2023-11-03 13:55:21,974 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0 2023-11-03 13:55:21,980 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-03 13:55:21,981 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 842ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:21,981 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:21,982 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:21,982 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:21,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:21,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:21,982 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,983 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:21,983 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:21,984 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,984 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:21,985 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,985 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:21,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:21,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@546516fd[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:21,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:21,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,987 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,988 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:21,988 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,988 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:21,988 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:21,988 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:21,991 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:21,991 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:21,991 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:21,991 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:21,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:21,994 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:21,995 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:21,995 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:21,995 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,995 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:21,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:21,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:21,998 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,002 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:22,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:22,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:22,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-03 13:55:22,005 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,005 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:22,006 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:22,006 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:22,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:22,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:22,106 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:22,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:22,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:22,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:22,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,114 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:22,114 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:22,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:22,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:22,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,115 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,116 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:22,116 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:22,117 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,117 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:22,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:22,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,118 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,118 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:22,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,118 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:22,118 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:22,118 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:22,118 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:22,118 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:22,118 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:22,119 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:22,119 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:55:22,534 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f95bc45cd1024a85b30f915d6887017d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f95bc45cd1024a85b30f915d6887017d 2023-11-03 13:55:22,543 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/b5f61587ee1d4353805d1dec4df13e0b 2023-11-03 13:55:22,548 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/b5f61587ee1d4353805d1dec4df13e0b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b 2023-11-03 13:55:22,553 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:55:22,554 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 435ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:22,554 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:22,554 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:22,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:22,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:22,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:22,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:22,556 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,556 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:22,556 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,556 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:22,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:22,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66157400[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:22,558 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:22,558 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,559 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,559 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:22,559 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:22,559 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:22,559 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,559 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:22,561 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:22,561 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:22,561 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:22,561 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:22,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:22,565 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:22,565 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:22,565 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:22,565 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,565 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:22,573 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,574 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:22,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,574 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:22,574 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,575 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:22,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:22,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:22,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:22,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:22,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:22,581 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:22,582 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:22,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-03 13:55:22,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:22,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:22,682 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:22,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:22,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:22,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,689 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:22,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:22,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:22,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:22,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,690 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:22,690 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:22,690 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:22,690 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,691 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:22,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:22,692 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:22,692 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:22,692 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:23,105 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:55:23,121 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bbf05f6ba23c407b87dea69e21a7b688 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bbf05f6ba23c407b87dea69e21a7b688 2023-11-03 13:55:23,554 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/d82458d5418b428084af712157f34a1b 2023-11-03 13:55:23,559 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/d82458d5418b428084af712157f34a1b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b 2023-11-03 13:55:23,565 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-03 13:55:23,566 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 874ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:23,566 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:23,566 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:23,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:23,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:23,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:23,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:23,568 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,568 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:23,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:23,569 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,569 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:23,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:23,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:23,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:23,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:23,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798bce6[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:23,570 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:23,570 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,571 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:23,572 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,572 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:23,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:23,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:23,573 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:23,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:23,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:23,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:23,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:23,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:23,576 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:23,576 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:23,576 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:23,576 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,576 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:23,578 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,578 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,578 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:23,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:23,579 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,580 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,584 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,585 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,585 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,585 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:23,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:23,585 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:23,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-03 13:55:23,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:23,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:23,585 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:23,585 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:23,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:23,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:23,685 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:23,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:23,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:23,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:23,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,695 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:23,695 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:23,695 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:23,695 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:23,702 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,703 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,708 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:23,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:23,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:23,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,708 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:23,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:23,715 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:23,715 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:23,715 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:23,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:23,718 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:23,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:23,718 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:23,718 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:23,739 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050b513242755d432bbc60424fce861642 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050b513242755d432bbc60424fce861642 2023-11-03 13:55:24,145 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/eec0d9d2458b47baa49796c99bafdd22 2023-11-03 13:55:24,154 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/eec0d9d2458b47baa49796c99bafdd22 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22 2023-11-03 13:55:24,162 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22, entries=1, sequenceid=17, filesize=5.0 K 2023-11-03 13:55:24,163 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 445ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:24,163 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:24,163 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:24,163 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:24,163 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:24,163 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,163 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:24,163 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:24,165 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,165 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,165 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:24,165 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:24,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:24,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:24,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:24,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:24,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:24,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@145195fb[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:24,168 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:24,168 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,168 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:24,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:24,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:24,169 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,169 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:24,170 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:24,171 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:24,171 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:24,171 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:24,173 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:24,173 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:24,173 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:24,173 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,173 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:24,175 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,175 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,176 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,182 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,183 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,190 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:24,190 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,191 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:24,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:24,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:24,191 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:24,291 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:24,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:24,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:24,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:24,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,298 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:24,298 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:24,298 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:24,298 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:24,299 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,299 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,300 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:24,300 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:24,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,301 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,301 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:24,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,302 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,302 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:24,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,302 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:24,303 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:24,303 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:24,303 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:24,303 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:24,303 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:24,303 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:24,303 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:24,326 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281751a9d4ea9f4dac8833e26118ab5cc9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281751a9d4ea9f4dac8833e26118ab5cc9 2023-11-03 13:55:24,732 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/c08e9eb3efec4216b9269f60e0934ed5 2023-11-03 13:55:24,739 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/c08e9eb3efec4216b9269f60e0934ed5 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5 2023-11-03 13:55:24,753 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5, entries=1, sequenceid=21, filesize=5.0 K 2023-11-03 13:55:24,755 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 452ms, sequenceid=21, compaction requested=true 2023-11-03 13:55:24,755 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:24,755 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:24,755 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:24,755 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:24,755 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,755 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:24,755 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:24,757 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,757 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:24,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:24,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:24,758 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,758 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:24,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:24,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:24,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ffab72[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:24,764 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:24,764 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,773 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,773 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:24,773 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:24,773 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:24,774 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:24,774 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:24,775 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:24,775 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:24,775 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,775 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:24,777 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,777 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:24,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,777 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:24,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:24,782 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,784 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,790 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,791 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:24,791 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:24,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:24,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:24,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:24,795 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:24,795 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:24,895 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:24,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:24,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:24,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:24,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,902 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:24,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:24,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:24,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:24,903 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,903 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,904 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:24,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,905 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:24,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:24,906 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:24,906 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:24,906 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:24,906 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:24,906 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:24,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:24,910 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:24,910 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:24,910 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:24,911 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:25,353 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123153e373a495f94ee19fda5b0861c37798 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123153e373a495f94ee19fda5b0861c37798 2023-11-03 13:55:25,381 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/92e9ef22c3654e97b0341360453a5d15 2023-11-03 13:55:25,397 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/92e9ef22c3654e97b0341360453a5d15 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15 2023-11-03 13:55:25,407 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15, entries=1, sequenceid=25, filesize=5.0 K 2023-11-03 13:55:25,418 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 508ms, sequenceid=25, compaction requested=true 2023-11-03 13:55:25,418 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:25,418 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:25,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:25,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:25,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:25,419 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:25,421 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,421 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,421 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,421 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:25,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25877719[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:25,424 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:25,424 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,425 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,425 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:25,425 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:25,425 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:25,426 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,426 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:25,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:25,427 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:25,426 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,427 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:25,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:25,430 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:25,430 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:25,430 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:25,430 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,430 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:25,433 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,433 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,433 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:25,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,435 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,437 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:25,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:25,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:25,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:25,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,440 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:25,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:25,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:25,440 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:25,441 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:25,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:25,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-03 13:55:25,541 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:25,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:25,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:25,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,550 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:25,550 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:25,550 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:25,550 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:25,551 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,551 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,552 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:25,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:25,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:25,553 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,554 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,554 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:25,554 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:25,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:25,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:25,554 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:25,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:25,555 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:25,555 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:25,555 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:25,556 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:25,599 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010125b41d64d6f340668e290c1513a024d5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010125b41d64d6f340668e290c1513a024d5 2023-11-03 13:55:25,614 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/9703857589d14a598a0865a345444e52 2023-11-03 13:55:25,620 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/9703857589d14a598a0865a345444e52 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52 2023-11-03 13:55:25,647 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52, entries=1, sequenceid=29, filesize=5.0 K 2023-11-03 13:55:25,654 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 98ms, sequenceid=29, compaction requested=true 2023-11-03 13:55:25,654 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:25,654 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:25,654 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:25,654 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:25,654 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,655 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:25,655 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:25,656 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,656 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,657 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,657 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:25,658 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:25,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673a80c3[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:25,658 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,659 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,659 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:25,659 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:25,659 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:25,659 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,659 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:25,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:25,667 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:25,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:25,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:25,671 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:25,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:25,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:25,671 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,671 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:25,673 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,673 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:25,674 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:25,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:25,676 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,678 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,680 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,681 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:25,681 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:25,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-03 13:55:25,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:25,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:25,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:25,682 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:25,682 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:25,782 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:25,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:25,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:25,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:25,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,801 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:25,801 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:25,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:25,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:25,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,802 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,806 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:25,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,808 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,808 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,809 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:25,809 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:25,810 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:25,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:25,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:25,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:25,810 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:25,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:25,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:25,812 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:25,812 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:25,812 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:25,934 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010318ea4011bbe44af1a22c55c1138f3e60 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010318ea4011bbe44af1a22c55c1138f3e60 2023-11-03 13:55:25,966 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/07ceace0de4f4f31a3f3ab07c51849a1 2023-11-03 13:55:25,978 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/07ceace0de4f4f31a3f3ab07c51849a1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1 2023-11-03 13:55:26,003 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1, entries=1, sequenceid=33, filesize=5.0 K 2023-11-03 13:55:26,006 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 194ms, sequenceid=33, compaction requested=true 2023-11-03 13:55:26,006 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:26,006 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:26,006 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:26,006 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:26,006 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,006 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:26,006 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:26,008 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:26,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:26,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:26,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fdc2f92[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:26,011 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:26,011 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,013 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,013 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:26,013 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,013 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:26,013 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:26,013 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:26,014 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:26,014 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,014 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:26,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:26,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:26,014 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:26,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:26,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:26,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:26,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:26,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:26,021 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:26,021 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:26,021 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:26,021 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,021 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:26,039 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,039 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,039 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:26,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:26,040 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,041 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:26,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:26,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:26,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,057 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,058 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:26,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:26,058 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:26,158 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:26,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:26,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:26,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:26,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,165 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:26,165 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:26,165 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:26,165 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:26,165 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,165 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,166 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:26,166 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:26,166 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:26,166 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,167 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:26,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:26,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:26,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:26,169 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:26,170 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:26,170 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:26,170 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:26,170 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:26,170 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:26,587 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c249f53f371b48e8b2a7c3ca83b4f53e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907c249f53f371b48e8b2a7c3ca83b4f53e 2023-11-03 13:55:26,992 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/e264f254f6c246dfa7fa063f0812e872 2023-11-03 13:55:27,011 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/e264f254f6c246dfa7fa063f0812e872 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872 2023-11-03 13:55:27,016 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872, entries=1, sequenceid=37, filesize=5.0 K 2023-11-03 13:55:27,018 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 848ms, sequenceid=37, compaction requested=true 2023-11-03 13:55:27,019 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:27,019 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:27,021 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:27,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:27,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:27,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a6daf20[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:27,023 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:27,023 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,024 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:27,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:27,025 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:27,025 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,025 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:27,026 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:27,026 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,026 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:27,026 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:27,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:27,030 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:27,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:27,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:27,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,030 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:27,032 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,032 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:27,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:27,032 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:27,035 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,036 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:27,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:27,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:27,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,042 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:27,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:27,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:27,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:27,043 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:27,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:27,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:27,143 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:27,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:27,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:27,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,152 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:27,152 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:27,152 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-03 13:55:27,152 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-03 13:55:27,152 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,152 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,153 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:27,153 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:27,154 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:27,154 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:27,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:27,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,158 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-03 13:55:27,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-03 13:55:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-03 13:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. started... 2023-11-03 13:55:27,160 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9ff818d7ca8c39b008fd99234a4e0bee 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:55:27,633 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200be9233fd928458191a6d572fde38c0b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200be9233fd928458191a6d572fde38c0b 2023-11-03 13:55:28,041 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/67bb662725214db6b9b196227965542e 2023-11-03 13:55:28,046 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/67bb662725214db6b9b196227965542e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e 2023-11-03 13:55:28,051 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e, entries=1, sequenceid=41, filesize=5.0 K 2023-11-03 13:55:28,052 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9ff818d7ca8c39b008fd99234a4e0bee in 892ms, sequenceid=41, compaction requested=true 2023-11-03 13:55:28,052 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:28,053 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:28,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:55:28,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:55:28,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-03 13:55:28,053 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-03 13:55:28,054 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:28,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,055 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:28,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-03 13:55:28,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@744c32cb[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:28,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-03 13:55:28,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,057 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,057 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-03 13:55:28,057 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-03 13:55:28,057 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,057 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:28,057 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:28,058 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-03 13:55:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:28,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:28,058 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-03 13:55:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:28,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-03 13:55:28,061 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-03 13:55:28,061 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:28,061 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:28,061 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,061 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:28,065 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,065 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:28,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,066 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:28,066 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,067 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,072 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,072 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:28,072 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-03 13:55:28,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:28,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:28,072 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:28,072 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:28,072 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:28,173 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:28,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:28,175 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:28,176 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:28,177 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:28,178 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020328178 2023-11-03 13:55:28,178 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:28,179 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:28,180 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-03 13:55:28,180 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:28,182 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x5c0ae116 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:28,188 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14364c4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:28,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,639 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030c7f61e3402e4548bdf4cdd773e53343 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601030c7f61e3402e4548bdf4cdd773e53343 2023-11-03 13:55:28,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:28,654 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:28,655 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:28,675 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:28,676 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:28,707 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/25cdc47cc63c4719999f20a7a0e01c71 first=Optional[r3] last=Optional[r6] 2023-11-03 13:55:28,708 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/25cdc47cc63c4719999f20a7a0e01c71}] 2023-11-03 13:55:28,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/25cdc47cc63c4719999f20a7a0e01c71 for inclusion in 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:28,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-03 13:55:28,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:28,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:28,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/25cdc47cc63c4719999f20a7a0e01c71 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c7okg77j393q9rl653vuj7odjtptgu1i4orlu0s653r2apir0i4f71d1giif6bui/family1/25cdc47cc63c4719999f20a7a0e01c71 2023-11-03 13:55:28,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c7okg77j393q9rl653vuj7odjtptgu1i4orlu0s653r2apir0i4f71d1giif6bui/family1/25cdc47cc63c4719999f20a7a0e01c71 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_ 2023-11-03 13:55:28,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c7okg77j393q9rl653vuj7odjtptgu1i4orlu0s653r2apir0i4f71d1giif6bui/family1/25cdc47cc63c4719999f20a7a0e01c71 into 9ff818d7ca8c39b008fd99234a4e0bee/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_ - updating store file list. 2023-11-03 13:55:28,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_ into 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:28,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c7okg77j393q9rl653vuj7odjtptgu1i4orlu0s653r2apir0i4f71d1giif6bui/family1/25cdc47cc63c4719999f20a7a0e01c71 into 9ff818d7ca8c39b008fd99234a4e0bee/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_) 2023-11-03 13:55:28,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c7okg77j393q9rl653vuj7odjtptgu1i4orlu0s653r2apir0i4f71d1giif6bui/family1/25cdc47cc63c4719999f20a7a0e01c71 2023-11-03 13:55:28,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:55:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:55:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 9ff818d7ca8c39b008fd99234a4e0bee/family1 is initiating minor compaction 2023-11-03 13:55:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@257ebfde; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:28,786 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9ff818d7ca8c39b008fd99234a4e0bee/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:28,787 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp, totalSize=50.3 K 2023-11-03 13:55:28,787 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting b5f61587ee1d4353805d1dec4df13e0b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:55:28,787 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting d82458d5418b428084af712157f34a1b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:55:28,787 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting eec0d9d2458b47baa49796c99bafdd22, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:55:28,787 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting c08e9eb3efec4216b9269f60e0934ed5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 92e9ef22c3654e97b0341360453a5d15, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 9703857589d14a598a0865a345444e52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 07ceace0de4f4f31a3f3ab07c51849a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting e264f254f6c246dfa7fa063f0812e872, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting 67bb662725214db6b9b196227965542e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:55:28,788 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:55:28,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:28,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:28,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281751a9d4ea9f4dac8833e26118ab5cc9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281751a9d4ea9f4dac8833e26118ab5cc9 2023-11-03 13:55:28,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123153e373a495f94ee19fda5b0861c37798 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123153e373a495f94ee19fda5b0861c37798 2023-11-03 13:55:28,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010125b41d64d6f340668e290c1513a024d5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010125b41d64d6f340668e290c1513a024d5 2023-11-03 13:55:28,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010318ea4011bbe44af1a22c55c1138f3e60 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010318ea4011bbe44af1a22c55c1138f3e60 2023-11-03 13:55:28,831 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-03 13:55:28,831 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-03 13:55:28,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:28,872 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): 9ff818d7ca8c39b008fd99234a4e0bee#family1#compaction#72 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:55:29,345 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/e890738de2fc415e99c68b06547546e6 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e890738de2fc415e99c68b06547546e6 2023-11-03 13:55:29,365 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9ff818d7ca8c39b008fd99234a4e0bee/family1 of 9ff818d7ca8c39b008fd99234a4e0bee into e890738de2fc415e99c68b06547546e6(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:29,365 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:29,365 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699019728786; duration=0sec 2023-11-03 13:55:29,365 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:29,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_] to archive 2023-11-03 13:55:29,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:29,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/b5f61587ee1d4353805d1dec4df13e0b 2023-11-03 13:55:29,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/d82458d5418b428084af712157f34a1b 2023-11-03 13:55:29,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/eec0d9d2458b47baa49796c99bafdd22 2023-11-03 13:55:29,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/c08e9eb3efec4216b9269f60e0934ed5 2023-11-03 13:55:29,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/92e9ef22c3654e97b0341360453a5d15 2023-11-03 13:55:29,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/9703857589d14a598a0865a345444e52 2023-11-03 13:55:29,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/07ceace0de4f4f31a3f3ab07c51849a1 2023-11-03 13:55:29,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e264f254f6c246dfa7fa063f0812e872 2023-11-03 13:55:29,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/67bb662725214db6b9b196227965542e 2023-11-03 13:55:29,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/a05ea2b05a2948f5a4a3a7227a460e7a_SeqId_44_ 2023-11-03 13:55:29,764 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057823ad3686ae4f7f85fa15fd372601bd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057823ad3686ae4f7f85fa15fd372601bd 2023-11-03 13:55:29,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:29,800 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8643591afdc1412ca716d6de328dd60a first=Optional[r00] last=Optional[r2] 2023-11-03 13:55:29,800 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8643591afdc1412ca716d6de328dd60a}] 2023-11-03 13:55:29,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8643591afdc1412ca716d6de328dd60a for inclusion in 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:29,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-03 13:55:29,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:29,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:29,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8643591afdc1412ca716d6de328dd60a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fs9bjh47tsdahqi1n7e8554ft1257t9go2trd0rpprvs557315sbqkjag1pe8l1c/family1/8643591afdc1412ca716d6de328dd60a 2023-11-03 13:55:29,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fs9bjh47tsdahqi1n7e8554ft1257t9go2trd0rpprvs557315sbqkjag1pe8l1c/family1/8643591afdc1412ca716d6de328dd60a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_ 2023-11-03 13:55:29,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fs9bjh47tsdahqi1n7e8554ft1257t9go2trd0rpprvs557315sbqkjag1pe8l1c/family1/8643591afdc1412ca716d6de328dd60a into 9ff818d7ca8c39b008fd99234a4e0bee/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_ - updating store file list. 2023-11-03 13:55:29,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_ into 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:29,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fs9bjh47tsdahqi1n7e8554ft1257t9go2trd0rpprvs557315sbqkjag1pe8l1c/family1/8643591afdc1412ca716d6de328dd60a into 9ff818d7ca8c39b008fd99234a4e0bee/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_) 2023-11-03 13:55:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fs9bjh47tsdahqi1n7e8554ft1257t9go2trd0rpprvs557315sbqkjag1pe8l1c/family1/8643591afdc1412ca716d6de328dd60a 2023-11-03 13:55:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:55:29,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:55:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 9ff818d7ca8c39b008fd99234a4e0bee/family1 is initiating minor compaction (all files) 2023-11-03 13:55:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@594ad4be; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:29,831 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9ff818d7ca8c39b008fd99234a4e0bee/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:29,831 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e890738de2fc415e99c68b06547546e6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp, totalSize=388.1 K 2023-11-03 13:55:29,831 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 90a0e6bb8f6d4bfb8d80dd538ac3f5c0, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:55:29,832 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting e890738de2fc415e99c68b06547546e6, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:55:29,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:29,833 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting faa5507ee1b7468a8d34f430b753ff54_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878817029 2023-11-03 13:55:29,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:29,835 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e228fb729fab4746b6e973d00bd61a1d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e228fb729fab4746b6e973d00bd61a1d 2023-11-03 13:55:29,837 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bbf05f6ba23c407b87dea69e21a7b688 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bbf05f6ba23c407b87dea69e21a7b688 2023-11-03 13:55:29,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050b513242755d432bbc60424fce861642 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050b513242755d432bbc60424fce861642 2023-11-03 13:55:29,841 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-03 13:55:29,841 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-03 13:55:29,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:29,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:29,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:29,845 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:29,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.6700 sec 2023-11-03 13:55:29,875 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9ff818d7ca8c39b008fd99234a4e0bee#family1#compaction#73 average throughput is 10.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:55:29,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-03 13:55:29,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:30,376 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:30,382 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:30,382 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:30,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-03 13:55:30,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE}] 2023-11-03 13:55:30,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE 2023-11-03 13:55:30,411 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:30,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019730411"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019730411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019730411"}]},"ts":"1699019730411"} 2023-11-03 13:55:30,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:30,579 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:30,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:30,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9ff818d7ca8c39b008fd99234a4e0bee, disabling compactions & flushes 2023-11-03 13:55:30,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:30,767 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/.tmp/family1/35f3acd5670846e886f769ae2d3c9b07 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/35f3acd5670846e886f769ae2d3c9b07 2023-11-03 13:55:30,775 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9ff818d7ca8c39b008fd99234a4e0bee/family1 of 9ff818d7ca8c39b008fd99234a4e0bee into 35f3acd5670846e886f769ae2d3c9b07(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:30,775 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:30,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:30,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:30,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. after waiting 0 ms 2023-11-03 13:55:30,775 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699019729831; duration=0sec 2023-11-03 13:55:30,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:30,776 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:30,776 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e890738de2fc415e99c68b06547546e6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_] to archive 2023-11-03 13:55:30,777 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:30,778 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/90a0e6bb8f6d4bfb8d80dd538ac3f5c0 2023-11-03 13:55:30,782 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e890738de2fc415e99c68b06547546e6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/e890738de2fc415e99c68b06547546e6 2023-11-03 13:55:30,784 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/faa5507ee1b7468a8d34f430b753ff54_SeqId_47_ 2023-11-03 13:55:30,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-03 13:55:30,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:30,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:30,789 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 9ff818d7ca8c39b008fd99234a4e0bee to self. 2023-11-03 13:55:30,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:30,790 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=CLOSED 2023-11-03 13:55:30,790 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019730790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019730790"}]},"ts":"1699019730790"} 2023-11-03 13:55:30,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-03 13:55:30,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288 in 365 msec 2023-11-03 13:55:30,793 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=true 2023-11-03 13:55:30,944 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:30,944 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019730943"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019730943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019730943"}]},"ts":"1699019730943"} 2023-11-03 13:55:30,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:31,097 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:31,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:31,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ff818d7ca8c39b008fd99234a4e0bee, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:31,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:31,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,108 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,111 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:31,112 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:31,112 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff818d7ca8c39b008fd99234a4e0bee columnFamilyName family1 2023-11-03 13:55:31,118 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/35f3acd5670846e886f769ae2d3c9b07 2023-11-03 13:55:31,118 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(310): Store=9ff818d7ca8c39b008fd99234a4e0bee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:31,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:31,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9ff818d7ca8c39b008fd99234a4e0bee; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73306044, jitterRate=0.09234517812728882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:31,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:31,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., pid=63, masterSystemTime=1699019731097 2023-11-03 13:55:31,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:31,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:31,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:31,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019731126"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019731126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019731126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019731126"}]},"ts":"1699019731126"} 2023-11-03 13:55:31,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-03 13:55:31,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288 in 182 msec 2023-11-03 13:55:31,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-03 13:55:31,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE in 720 msec 2023-11-03 13:55:31,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-03 13:55:31,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 732 msec 2023-11-03 13:55:31,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1840 sec 2023-11-03 13:55:31,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-03 13:55:31,135 INFO [Listener at localhost/39963] compactions.TestMobCompactor(278): alter status finished 2023-11-03 13:55:31,136 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:31,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:31,138 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:31,139 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:31,139 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020331139 2023-11-03 13:55:31,140 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:31,140 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-03 13:55:31,140 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:31,141 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x7473d2a4 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:31,306 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5706a1da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:31,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:31,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:31,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:31,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:31,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:32,175 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289b1c5009b5284c3ba06d8aac94a7d345 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289b1c5009b5284c3ba06d8aac94a7d345 2023-11-03 13:55:32,182 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:32,234 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:32,236 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:32,286 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:32,290 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:32,365 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a7a396bed124b5f9553f81d1d679b5b first=Optional[r05] last=Optional[r8] 2023-11-03 13:55:32,374 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=51 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a7a396bed124b5f9553f81d1d679b5b}] 2023-11-03 13:55:32,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a7a396bed124b5f9553f81d1d679b5b for inclusion in 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:32,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-03 13:55:32,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:32,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a7a396bed124b5f9553f81d1d679b5b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rvg5uo4v0iscidimahc27ts80knkuddc41g3kdi9nohsjs08j1pu63b3tl2102k1/family1/8a7a396bed124b5f9553f81d1d679b5b 2023-11-03 13:55:32,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rvg5uo4v0iscidimahc27ts80knkuddc41g3kdi9nohsjs08j1pu63b3tl2102k1/family1/8a7a396bed124b5f9553f81d1d679b5b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/f0602dffb2b8434790d3a5c00bde1f5d_SeqId_53_ 2023-11-03 13:55:32,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rvg5uo4v0iscidimahc27ts80knkuddc41g3kdi9nohsjs08j1pu63b3tl2102k1/family1/8a7a396bed124b5f9553f81d1d679b5b into 9ff818d7ca8c39b008fd99234a4e0bee/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/f0602dffb2b8434790d3a5c00bde1f5d_SeqId_53_ - updating store file list. 2023-11-03 13:55:32,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/f0602dffb2b8434790d3a5c00bde1f5d_SeqId_53_ into 9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:32,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rvg5uo4v0iscidimahc27ts80knkuddc41g3kdi9nohsjs08j1pu63b3tl2102k1/family1/8a7a396bed124b5f9553f81d1d679b5b into 9ff818d7ca8c39b008fd99234a4e0bee/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/f0602dffb2b8434790d3a5c00bde1f5d_SeqId_53_) 2023-11-03 13:55:32,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rvg5uo4v0iscidimahc27ts80knkuddc41g3kdi9nohsjs08j1pu63b3tl2102k1/family1/8a7a396bed124b5f9553f81d1d679b5b 2023-11-03 13:55:32,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:32,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:32,502 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200be9233fd928458191a6d572fde38c0b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200be9233fd928458191a6d572fde38c0b 2023-11-03 13:55:32,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f95bc45cd1024a85b30f915d6887017d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f95bc45cd1024a85b30f915d6887017d 2023-11-03 13:55:32,506 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-03 13:55:32,506 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-03 13:55:32,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:32,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:32,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:32,509 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:32,509 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:32,516 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:32,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.3790 sec 2023-11-03 13:55:32,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-03 13:55:32,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:32,846 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-03 13:55:32,853 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:32,853 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-03 13:55:32,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-03 13:55:32,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE}] 2023-11-03 13:55:32,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE 2023-11-03 13:55:32,866 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:32,867 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019732866"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019732866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019732866"}]},"ts":"1699019732866"} 2023-11-03 13:55:32,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:33,032 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9ff818d7ca8c39b008fd99234a4e0bee, disabling compactions & flushes 2023-11-03 13:55:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. after waiting 0 ms 2023-11-03 13:55:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-03 13:55:33,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:33,066 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 9ff818d7ca8c39b008fd99234a4e0bee to self. 2023-11-03 13:55:33,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=CLOSED 2023-11-03 13:55:33,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019733096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019733096"}]},"ts":"1699019733096"} 2023-11-03 13:55:33,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-03 13:55:33,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288 in 235 msec 2023-11-03 13:55:33,142 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=true 2023-11-03 13:55:33,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:33,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019733294"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019733294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019733294"}]},"ts":"1699019733294"} 2023-11-03 13:55:33,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:33,482 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:33,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ff818d7ca8c39b008fd99234a4e0bee, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,488 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,489 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:33,489 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1 2023-11-03 13:55:33,490 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff818d7ca8c39b008fd99234a4e0bee columnFamilyName family1 2023-11-03 13:55:33,557 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/35f3acd5670846e886f769ae2d3c9b07 2023-11-03 13:55:33,590 DEBUG [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/family1/f0602dffb2b8434790d3a5c00bde1f5d_SeqId_53_ 2023-11-03 13:55:33,590 INFO [StoreOpener-9ff818d7ca8c39b008fd99234a4e0bee-1] regionserver.HStore(310): Store=9ff818d7ca8c39b008fd99234a4e0bee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:33,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:55:33,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9ff818d7ca8c39b008fd99234a4e0bee; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74457865, jitterRate=0.10950864851474762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:33,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:55:33,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee., pid=69, masterSystemTime=1699019733482 2023-11-03 13:55:33,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9ff818d7ca8c39b008fd99234a4e0bee, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:33,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699019733652"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019733652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019733652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019733652"}]},"ts":"1699019733652"} 2023-11-03 13:55:33,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:55:33,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-03 13:55:33,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 9ff818d7ca8c39b008fd99234a4e0bee, server=jenkins-hbase20.apache.org,46707,1699019650288 in 344 msec 2023-11-03 13:55:33,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-03 13:55:33,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9ff818d7ca8c39b008fd99234a4e0bee, REOPEN/MOVE in 808 msec 2023-11-03 13:55:33,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 932 msec 2023-11-03 13:55:33,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-03 13:55:33,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 816 msec 2023-11-03 13:55:33,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-03 13:55:33,686 INFO [Listener at localhost/39963] compactions.TestMobCompactor(278): alter status finished 2023-11-03 13:55:33,688 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-03 13:55:33,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:33,692 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:33,693 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020333693 2023-11-03 13:55:33,693 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:33,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:55:33,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-03 13:55:33,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:33,698 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x69622619 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:33,760 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2125b02b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-03 13:55:33,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-03 13:55:33,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:33,787 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-03 13:55:33,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 97 msec 2023-11-03 13:55:33,921 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=258 (was 252) - Thread LEAK? -, OpenFileDescriptor=682 (was 648) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1102 (was 1213), ProcessCount=193 (was 193), AvailableMemoryMB=1081 (was 2343) 2023-11-03 13:55:33,940 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=257, OpenFileDescriptor=681, MaxFileDescriptor=60000, SystemLoadAverage=1102, ProcessCount=193, AvailableMemoryMB=1080 2023-11-03 13:55:33,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-03 13:55:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:33,950 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:55:33,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-03 13:55:33,951 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:55:33,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-03 13:55:33,953 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:33,954 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 empty. 2023-11-03 13:55:33,954 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:33,954 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-03 13:55:33,986 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:33,987 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1f7d81370e60f6fa6ffec450007260a9, NAME => 'testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:34,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-03 13:55:34,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 1f7d81370e60f6fa6ffec450007260a9, disabling compactions & flushes 2023-11-03 13:55:34,399 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. after waiting 0 ms 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,399 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,399 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:34,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:55:34,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699019734404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019734404"}]},"ts":"1699019734404"} 2023-11-03 13:55:34,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:55:34,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:55:34,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019734406"}]},"ts":"1699019734406"} 2023-11-03 13:55:34,408 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-03 13:55:34,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, ASSIGN}] 2023-11-03 13:55:34,417 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, ASSIGN 2023-11-03 13:55:34,418 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:34,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-03 13:55:34,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1f7d81370e60f6fa6ffec450007260a9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:34,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699019734571"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019734571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019734571"}]},"ts":"1699019734571"} 2023-11-03 13:55:34,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 1f7d81370e60f6fa6ffec450007260a9, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:34,745 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:34,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f7d81370e60f6fa6ffec450007260a9, NAME => 'testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:55:34,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-03 13:55:34,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-03 13:55:34,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:34,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,762 INFO [StoreOpener-1f7d81370e60f6fa6ffec450007260a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,775 DEBUG [StoreOpener-1f7d81370e60f6fa6ffec450007260a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1 2023-11-03 13:55:34,775 DEBUG [StoreOpener-1f7d81370e60f6fa6ffec450007260a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1 2023-11-03 13:55:34,776 INFO [StoreOpener-1f7d81370e60f6fa6ffec450007260a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f7d81370e60f6fa6ffec450007260a9 columnFamilyName f1 2023-11-03 13:55:34,784 INFO [StoreOpener-1f7d81370e60f6fa6ffec450007260a9-1] regionserver.HStore(310): Store=1f7d81370e60f6fa6ffec450007260a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:34,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:34,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1f7d81370e60f6fa6ffec450007260a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60212945, jitterRate=-0.10275720059871674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:55:34,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:34,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9., pid=73, masterSystemTime=1699019734744 2023-11-03 13:55:34,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:34,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1f7d81370e60f6fa6ffec450007260a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:34,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699019734882"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019734882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019734882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019734882"}]},"ts":"1699019734882"} 2023-11-03 13:55:34,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-03 13:55:34,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 1f7d81370e60f6fa6ffec450007260a9, server=jenkins-hbase20.apache.org,46707,1699019650288 in 306 msec 2023-11-03 13:55:34,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-03 13:55:34,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, ASSIGN in 514 msec 2023-11-03 13:55:34,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:55:34,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019734934"}]},"ts":"1699019734934"} 2023-11-03 13:55:34,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-03 13:55:34,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:55:34,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.0110 sec 2023-11-03 13:55:35,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-03 13:55:35,059 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-03 13:55:35,059 DEBUG [Listener at localhost/39963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-03 13:55:35,061 INFO [Listener at localhost/39963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-03 13:55:35,071 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-03 13:55:35,072 INFO [Listener at localhost/39963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-03 13:55:35,072 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-03 13:55:35,082 INFO [Listener at localhost/39963] regionserver.HRegion(2745): Flushing 1f7d81370e60f6fa6ffec450007260a9 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-03 13:55:35,545 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103c7ac8f3c35864258a2c6b97b7dc12ecf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231103c7ac8f3c35864258a2c6b97b7dc12ecf 2023-11-03 13:55:35,969 INFO [Listener at localhost/39963] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp/f1/ad733557e75148b5892e20f54b9a033b 2023-11-03 13:55:35,980 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp/f1/ad733557e75148b5892e20f54b9a033b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b 2023-11-03 13:55:35,985 INFO [Listener at localhost/39963] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b, entries=1, sequenceid=5, filesize=4.9 K 2023-11-03 13:55:35,986 INFO [Listener at localhost/39963] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1f7d81370e60f6fa6ffec450007260a9 in 904ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:35,987 DEBUG [Listener at localhost/39963] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-03 13:55:35,988 DEBUG [Listener at localhost/39963] regionserver.HRegion(2446): Flush status journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:35,990 INFO [Listener at localhost/39963] regionserver.HRegion(2745): Flushing 1f7d81370e60f6fa6ffec450007260a9 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-03 13:55:36,017 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311037416818ffa484925a96b1a9142f5c859 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311037416818ffa484925a96b1a9142f5c859 2023-11-03 13:55:36,024 INFO [Listener at localhost/39963] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp/f1/d04fa54c53924b86bf2d7481b7b5a8eb 2023-11-03 13:55:36,032 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp/f1/d04fa54c53924b86bf2d7481b7b5a8eb as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb 2023-11-03 13:55:36,036 INFO [Listener at localhost/39963] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb, entries=1, sequenceid=9, filesize=4.9 K 2023-11-03 13:55:36,039 INFO [Listener at localhost/39963] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1f7d81370e60f6fa6ffec450007260a9 in 49ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:36,039 DEBUG [Listener at localhost/39963] regionserver.HRegion(2446): Flush status journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:36,043 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-03 13:55:36,045 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-03 13:55:36,046 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-03 13:55:36,048 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020336048 2023-11-03 13:55:36,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:36,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:55:36,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-03 13:55:36,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-03 13:55:36,051 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x68d0565f to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:36,367 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:55:36,374 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:36,374 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x010b1b89 to 127.0.0.1:53668 2023-11-03 13:55:36,375 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69622619 to 127.0.0.1:53668 2023-11-03 13:55:36,375 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,375 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:36,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7473d2a4 to 127.0.0.1:53668 2023-11-03 13:55:36,375 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,375 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:36,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b302c15 to 127.0.0.1:53668 2023-11-03 13:55:36,375 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,376 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65dd49ca to 127.0.0.1:53668 2023-11-03 13:55:36,376 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,376 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:36,376 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d41753 to 127.0.0.1:53668 2023-11-03 13:55:36,376 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,376 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:55:36,376 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c0ae116 to 127.0.0.1:53668 2023-11-03 13:55:36,376 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:36,382 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-03 13:55:36,384 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,384 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64780786, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:36,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231103 for table='testGetAfterCompaction' and column='f1' 2023-11-03 13:55:36,443 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,443 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,494 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,494 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,514 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311034ee4ff5c1d8944a0bb3c571e27c93ef9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311034ee4ff5c1d8944a0bb3c571e27c93ef9 2023-11-03 13:55:36,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testGetAfterCompaction' column='f1' 2023-11-03 13:55:36,542 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:36,543 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:36,545 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,545 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,597 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,597 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,598 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:36,604 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:36,631 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/f1/1d816e69cbde46cab7c5364b22f76042 first=Optional[r1] last=Optional[r2] 2023-11-03 13:55:36,633 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{f1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/f1/1d816e69cbde46cab7c5364b22f76042}] 2023-11-03 13:55:36,648 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,648 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/f1/1d816e69cbde46cab7c5364b22f76042 for inclusion in 1f7d81370e60f6fa6ffec450007260a9/f1 2023-11-03 13:55:36,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-03 13:55:36,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:55:36,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/f1/1d816e69cbde46cab7c5364b22f76042 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testGetAfterCompaction__ptgkn7mk6so8odpgsuofgp0mm3cir5u7cgkb2b0mctf2ea6pn96tblbfdhn295f9/f1/1d816e69cbde46cab7c5364b22f76042 2023-11-03 13:55:36,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testGetAfterCompaction__ptgkn7mk6so8odpgsuofgp0mm3cir5u7cgkb2b0mctf2ea6pn96tblbfdhn295f9/f1/1d816e69cbde46cab7c5364b22f76042 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_ 2023-11-03 13:55:36,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testGetAfterCompaction__ptgkn7mk6so8odpgsuofgp0mm3cir5u7cgkb2b0mctf2ea6pn96tblbfdhn295f9/f1/1d816e69cbde46cab7c5364b22f76042 into 1f7d81370e60f6fa6ffec450007260a9/f1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_ - updating store file list. 2023-11-03 13:55:36,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_ into 1f7d81370e60f6fa6ffec450007260a9/f1 2023-11-03 13:55:36,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testGetAfterCompaction__ptgkn7mk6so8odpgsuofgp0mm3cir5u7cgkb2b0mctf2ea6pn96tblbfdhn295f9/f1/1d816e69cbde46cab7c5364b22f76042 into 1f7d81370e60f6fa6ffec450007260a9/f1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_) 2023-11-03 13:55:36,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testGetAfterCompaction__ptgkn7mk6so8odpgsuofgp0mm3cir5u7cgkb2b0mctf2ea6pn96tblbfdhn295f9/f1/1d816e69cbde46cab7c5364b22f76042 2023-11-03 13:55:36,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 1f7d81370e60f6fa6ffec450007260a9/f1 is initiating minor compaction 2023-11-03 13:55:36,669 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1f7d81370e60f6fa6ffec450007260a9/f1 in testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:36,670 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp, totalSize=10.0 K 2023-11-03 13:55:36,670 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting d04fa54c53924b86bf2d7481b7b5a8eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:55:36,670 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:55:36,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@36ac342c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:36,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testGetAfterCompaction' column='f1' 2023-11-03 13:55:36,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:36,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311037416818ffa484925a96b1a9142f5c859 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311037416818ffa484925a96b1a9142f5c859 2023-11-03 13:55:36,700 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699019736509; access_time=1699019736475; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-03 13:55:36,700 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,700 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,702 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1f7d81370e60f6fa6ffec450007260a9#f1#compaction#76 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:55:36,706 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231103c7ac8f3c35864258a2c6b97b7dc12ecf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231103c7ac8f3c35864258a2c6b97b7dc12ecf 2023-11-03 13:55:36,706 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-03 13:55:36,706 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231103' 2023-11-03 13:55:36,710 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231103 for table='testGetAfterCompaction' and column='f1' 2023-11-03 13:55:36,710 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-03 13:55:36,710 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:55:36,712 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-03 13:55:36,713 DEBUG [Listener at localhost/39963] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-03 13:55:36,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 668 msec 2023-11-03 13:55:36,723 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-03 13:55:36,723 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46707] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:36,724 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-03 13:55:36,724 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-03 13:55:36,724 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46707] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-03 13:55:36,724 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46707] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. because compaction request was cancelled 2023-11-03 13:55:36,781 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699019736509; access_time=1699019736475; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-03 13:55:36,782 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,782 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,795 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/.tmp/f1/39909746480940e4b4acaa3d883e8562 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562 2023-11-03 13:55:36,803 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 1f7d81370e60f6fa6ffec450007260a9/f1 of 1f7d81370e60f6fa6ffec450007260a9 into 39909746480940e4b4acaa3d883e8562(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:36,804 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:36,804 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699019736669; duration=0sec 2023-11-03 13:55:36,804 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:55:36,834 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699019736771; access_time=1699019736688; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,834 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699019736509; access_time=1699019736475; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-03 13:55:36,834 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,835 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,889 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699019736771; access_time=1699019736688; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,889 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699019736509; access_time=1699019736475; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-03 13:55:36,889 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,889 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019736024; access_time=1699019735992; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_] to archive 2023-11-03 13:55:36,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:36,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/d04fa54c53924b86bf2d7481b7b5a8eb 2023-11-03 13:55:36,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/a2042bb0f22e415ebbfc9c8157b6d49f_SeqId_12_ 2023-11-03 13:55:36,943 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699019736771; access_time=1699019736688; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:36,943 INFO [Listener at localhost/39963] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699019735968; access_time=1699019735095; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-03 13:55:37,103 INFO [Listener at localhost/39963] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-03 13:55:37,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-11-03 13:55:37,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019737129"}]},"ts":"1699019737129"} 2023-11-03 13:55:37,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-03 13:55:37,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-03 13:55:37,162 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-03 13:55:37,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, UNASSIGN}] 2023-11-03 13:55:37,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, UNASSIGN 2023-11-03 13:55:37,170 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1f7d81370e60f6fa6ffec450007260a9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:37,170 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699019737170"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019737170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019737170"}]},"ts":"1699019737170"} 2023-11-03 13:55:37,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 1f7d81370e60f6fa6ffec450007260a9, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:37,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-03 13:55:37,330 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:37,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:37,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1f7d81370e60f6fa6ffec450007260a9, disabling compactions & flushes 2023-11-03 13:55:37,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:37,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:37,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. after waiting 0 ms 2023-11-03 13:55:37,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:37,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-03 13:55:37,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-03 13:55:37,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9. 2023-11-03 13:55:37,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1f7d81370e60f6fa6ffec450007260a9: 2023-11-03 13:55:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:37,380 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1f7d81370e60f6fa6ffec450007260a9, regionState=CLOSED 2023-11-03 13:55:37,380 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699019737380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019737380"}]},"ts":"1699019737380"} 2023-11-03 13:55:37,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-03 13:55:37,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 1f7d81370e60f6fa6ffec450007260a9, server=jenkins-hbase20.apache.org,46707,1699019650288 in 213 msec 2023-11-03 13:55:37,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-03 13:55:37,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1f7d81370e60f6fa6ffec450007260a9, UNASSIGN in 229 msec 2023-11-03 13:55:37,400 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019737400"}]},"ts":"1699019737400"} 2023-11-03 13:55:37,403 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-03 13:55:37,419 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-03 13:55:37,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 307 msec 2023-11-03 13:55:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-03 13:55:37,458 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-03 13:55:37,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-11-03 13:55:37,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-03 13:55:37,493 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:37,507 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1, FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/recovered.edits] 2023-11-03 13:55:37,530 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/39909746480940e4b4acaa3d883e8562 2023-11-03 13:55:37,532 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/f1/ad733557e75148b5892e20f54b9a033b 2023-11-03 13:55:37,541 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/recovered.edits/15.seqid to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9/recovered.edits/15.seqid 2023-11-03 13:55:37,542 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testGetAfterCompaction/1f7d81370e60f6fa6ffec450007260a9 2023-11-03 13:55:37,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-03 13:55:37,544 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-03 13:55:37,550 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-03 13:55:37,567 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311034ee4ff5c1d8944a0bb3c571e27c93ef9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311034ee4ff5c1d8944a0bb3c571e27c93ef9 2023-11-03 13:55:37,567 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-03 13:55:37,573 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-03 13:55:37,610 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-03 13:55:37,637 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-03 13:55:37,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-03 13:55:37,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699019737652"}]},"ts":"9223372036854775807"} 2023-11-03 13:55:37,671 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-03 13:55:37,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1f7d81370e60f6fa6ffec450007260a9, NAME => 'testGetAfterCompaction,,1699019733943.1f7d81370e60f6fa6ffec450007260a9.', STARTKEY => '', ENDKEY => ''}] 2023-11-03 13:55:37,671 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-03 13:55:37,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699019737671"}]},"ts":"9223372036854775807"} 2023-11-03 13:55:37,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-03 13:55:37,695 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-03 13:55:37,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 226 msec 2023-11-03 13:55:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-03 13:55:37,797 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-03 13:55:37,813 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245 (was 257), OpenFileDescriptor=634 (was 681), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1102 (was 1102), ProcessCount=191 (was 193), AvailableMemoryMB=634 (was 1080) 2023-11-03 13:55:37,829 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=245, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=1102, ProcessCount=191, AvailableMemoryMB=631 2023-11-03 13:55:37,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-03 13:55:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-03 13:55:37,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:55:37,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-03 13:55:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:37,842 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:55:37,846 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:37,846 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:37,846 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:37,851 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc empty. 2023-11-03 13:55:37,851 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 empty. 2023-11-03 13:55:37,851 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba empty. 2023-11-03 13:55:37,851 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:37,851 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:37,852 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:37,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-03 13:55:37,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:38,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:38,260 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:38,262 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c1895869427f29144d076bec60ad1ba7, NAME => 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:38,263 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 46cdc5862837157d20f70fafedc327bc, NAME => 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:38,263 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => c349b5a83940e7ac1020a6ff54953bba, NAME => 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:55:38,280 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c1895869427f29144d076bec60ad1ba7, disabling compactions & flushes 2023-11-03 13:55:38,281 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. after waiting 0 ms 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:38,281 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing c349b5a83940e7ac1020a6ff54953bba, disabling compactions & flushes 2023-11-03 13:55:38,281 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. after waiting 0 ms 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:38,281 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:38,281 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:38,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 46cdc5862837157d20f70fafedc327bc, disabling compactions & flushes 2023-11-03 13:55:38,684 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. after waiting 0 ms 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:38,684 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:38,684 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:38,687 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:55:38,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019738688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019738688"}]},"ts":"1699019738688"} 2023-11-03 13:55:38,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019738688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019738688"}]},"ts":"1699019738688"} 2023-11-03 13:55:38,689 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019738688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019738688"}]},"ts":"1699019738688"} 2023-11-03 13:55:38,694 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-03 13:55:38,695 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:55:38,695 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019738695"}]},"ts":"1699019738695"} 2023-11-03 13:55:38,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-03 13:55:38,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN}] 2023-11-03 13:55:38,704 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN 2023-11-03 13:55:38,705 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN 2023-11-03 13:55:38,705 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN 2023-11-03 13:55:38,706 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:38,706 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:38,706 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:55:38,859 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:38,859 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019738859"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019738859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019738859"}]},"ts":"1699019738859"} 2023-11-03 13:55:38,860 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:38,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019738860"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019738860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019738860"}]},"ts":"1699019738860"} 2023-11-03 13:55:38,860 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:38,860 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019738860"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019738860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019738860"}]},"ts":"1699019738860"} 2023-11-03 13:55:38,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:38,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:38,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:39,026 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:39,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c349b5a83940e7ac1020a6ff54953bba, NAME => 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.', STARTKEY => '2', ENDKEY => ''} 2023-11-03 13:55:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,032 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,033 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:55:39,034 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:55:39,034 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c349b5a83940e7ac1020a6ff54953bba columnFamilyName family1 2023-11-03 13:55:39,037 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(310): Store=c349b5a83940e7ac1020a6ff54953bba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,038 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,040 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2 2023-11-03 13:55:39,040 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2 2023-11-03 13:55:39,040 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c349b5a83940e7ac1020a6ff54953bba columnFamilyName family2 2023-11-03 13:55:39,042 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(310): Store=c349b5a83940e7ac1020a6ff54953bba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:55:39,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:39,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:39,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c349b5a83940e7ac1020a6ff54953bba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75182002, jitterRate=0.12029913067817688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:55:39,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:39,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., pid=83, masterSystemTime=1699019739026 2023-11-03 13:55:39,071 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:39,071 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019739071"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019739071"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019739071"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019739071"}]},"ts":"1699019739071"} 2023-11-03 13:55:39,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:39,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:39,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:39,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46cdc5862837157d20f70fafedc327bc, NAME => 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.', STARTKEY => '', ENDKEY => '1'} 2023-11-03 13:55:39,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:39,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,077 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-11-03 13:55:39,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288 in 204 msec 2023-11-03 13:55:39,083 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:55:39,083 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:55:39,083 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cdc5862837157d20f70fafedc327bc columnFamilyName family1 2023-11-03 13:55:39,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN in 379 msec 2023-11-03 13:55:39,093 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(310): Store=46cdc5862837157d20f70fafedc327bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,094 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,109 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2 2023-11-03 13:55:39,109 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2 2023-11-03 13:55:39,110 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cdc5862837157d20f70fafedc327bc columnFamilyName family2 2023-11-03 13:55:39,111 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(310): Store=46cdc5862837157d20f70fafedc327bc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:55:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:39,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:39,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 46cdc5862837157d20f70fafedc327bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60111783, jitterRate=-0.10426463186740875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:55:39,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:39,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., pid=85, masterSystemTime=1699019739026 2023-11-03 13:55:39,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:39,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019739159"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019739159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019739159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019739159"}]},"ts":"1699019739159"} 2023-11-03 13:55:39,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:39,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:39,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:39,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1895869427f29144d076bec60ad1ba7, NAME => 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-03 13:55:39,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:55:39,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,170 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,186 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:55:39,186 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:55:39,187 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1895869427f29144d076bec60ad1ba7 columnFamilyName family1 2023-11-03 13:55:39,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-11-03 13:55:39,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288 in 305 msec 2023-11-03 13:55:39,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN in 492 msec 2023-11-03 13:55:39,194 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(310): Store=c1895869427f29144d076bec60ad1ba7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,195 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,226 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2 2023-11-03 13:55:39,226 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2 2023-11-03 13:55:39,227 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1895869427f29144d076bec60ad1ba7 columnFamilyName family2 2023-11-03 13:55:39,229 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(310): Store=c1895869427f29144d076bec60ad1ba7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:55:39,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:55:39,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:55:39,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c1895869427f29144d076bec60ad1ba7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66260678, jitterRate=-0.012638956308364868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:55:39,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:39,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., pid=84, masterSystemTime=1699019739026 2023-11-03 13:55:39,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:39,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:39,362 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:39,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019739362"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019739362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019739362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019739362"}]},"ts":"1699019739362"} 2023-11-03 13:55:39,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-11-03 13:55:39,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288 in 511 msec 2023-11-03 13:55:39,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-03 13:55:39,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN in 693 msec 2023-11-03 13:55:39,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:55:39,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019739405"}]},"ts":"1699019739405"} 2023-11-03 13:55:39,418 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-03 13:55:39,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:55:39,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.6120 sec 2023-11-03 13:55:39,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-03 13:55:39,954 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-03 13:55:39,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:39,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:39,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:40,000 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:40,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-03 13:55:40,022 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-03 13:55:40,022 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:40,022 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-03 13:55:40,022 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-03 13:55:40,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:40,030 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:40,033 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:40,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:40,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:40,038 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:40,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:40,041 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-03 13:55:40,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-03 13:55:40,050 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-03 13:55:40,050 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:40,051 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-03 13:55:40,058 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:40,058 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:40,067 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:40,067 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:40,070 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:55:40,070 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:40,077 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c1895869427f29144d076bec60ad1ba7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:55:40,077 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46cdc5862837157d20f70fafedc327bc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:55:40,078 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:40,078 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:40,086 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c349b5a83940e7ac1020a6ff54953bba 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:55:40,208 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b 2023-11-03 13:55:40,248 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 2023-11-03 13:55:40,646 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 2023-11-03 13:55:40,652 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/6f25fa054ca34fb59c2240fb9b1370b9 2023-11-03 13:55:40,701 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/a08b2d1b997e499a9307c709dc2ab73a 2023-11-03 13:55:40,715 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/d702b2dae9494e308f56c080fc8a715c 2023-11-03 13:55:40,737 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927 2023-11-03 13:55:40,814 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/469fb41cfc054cf3a4dcab4b2bc4766d 2023-11-03 13:55:40,882 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/6f25fa054ca34fb59c2240fb9b1370b9 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9 2023-11-03 13:55:40,908 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:55:40,912 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/469fb41cfc054cf3a4dcab4b2bc4766d as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d 2023-11-03 13:55:40,941 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:55:40,942 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 46cdc5862837157d20f70fafedc327bc in 865ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:40,942 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-03 13:55:40,943 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:40,943 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:40,943 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:55:41,259 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c 2023-11-03 13:55:41,273 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a 2023-11-03 13:55:41,293 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/394adb639ec6484e9678e5c2173893d1 2023-11-03 13:55:41,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/d702b2dae9494e308f56c080fc8a715c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c 2023-11-03 13:55:41,316 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:55:41,319 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/394adb639ec6484e9678e5c2173893d1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1 2023-11-03 13:55:41,325 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:55:41,326 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c1895869427f29144d076bec60ad1ba7 in 1249ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:41,328 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:41,328 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:41,328 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:55:41,694 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b 2023-11-03 13:55:41,700 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/a08b2d1b997e499a9307c709dc2ab73a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a 2023-11-03 13:55:41,705 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:55:41,712 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b 2023-11-03 13:55:41,727 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:55:41,728 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c349b5a83940e7ac1020a6ff54953bba in 1642ms, sequenceid=5, compaction requested=false 2023-11-03 13:55:41,728 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:41,728 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:55:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:55:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-03 13:55:41,729 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-03 13:55:41,734 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:41,734 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:41,735 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,735 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:41,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:41,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-03 13:55:41,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47438819[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:41,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-03 13:55:41,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,747 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,747 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-03 13:55:41,747 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-03 13:55:41,747 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:41,747 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,747 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:41,748 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-03 13:55:41,748 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:41,748 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-03 13:55:41,749 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:41,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-03 13:55:41,752 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-03 13:55:41,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:41,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:41,752 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-03 13:55:41,752 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:41,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,754 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,755 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:41,758 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,761 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:41,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:41,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,763 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:41,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-03 13:55:41,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:41,764 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:41,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:41,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-03 13:55:41,764 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:41,763 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:41,764 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,864 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:41,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:41,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:41,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:41,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:41,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:41,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:41,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-03 13:55:41,914 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-03 13:55:41,914 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:41,914 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-03 13:55:41,914 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-03 13:55:41,922 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,922 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:41,926 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:41,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:41,927 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,927 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:41,927 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:41,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:41,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-03 13:55:41,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-03 13:55:41,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-03 13:55:41,940 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-03 13:55:41,940 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:41,940 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-03 13:55:41,941 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:41,941 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:41,942 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c1895869427f29144d076bec60ad1ba7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:55:41,943 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:55:41,943 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:41,944 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:41,944 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:41,944 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:41,944 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:41,944 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46cdc5862837157d20f70fafedc327bc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:55:41,944 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c349b5a83940e7ac1020a6ff54953bba 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:55:42,415 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 2023-11-03 13:55:42,427 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad 2023-11-03 13:55:42,440 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 2023-11-03 13:55:42,446 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/3fa62a6697f944168b9cb04ef69e95fc 2023-11-03 13:55:42,512 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457 2023-11-03 13:55:42,530 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/53ac5f61bd52429690a87e9444a57c60 2023-11-03 13:55:42,537 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/3fa62a6697f944168b9cb04ef69e95fc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc 2023-11-03 13:55:42,543 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:55:42,544 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/53ac5f61bd52429690a87e9444a57c60 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60 2023-11-03 13:55:42,563 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:55:42,565 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c1895869427f29144d076bec60ad1ba7 in 623ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:42,565 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:42,565 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:42,566 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:55:42,825 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/261e6ad667ce40afa2f2ae6a3bec3a38 2023-11-03 13:55:42,847 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1 2023-11-03 13:55:42,863 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/969238407e7349cb98a7229815109072 2023-11-03 13:55:42,867 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/d604c7ad22fd491cbac6063b8a5930dd 2023-11-03 13:55:42,869 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/261e6ad667ce40afa2f2ae6a3bec3a38 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38 2023-11-03 13:55:42,874 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:55:42,875 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/969238407e7349cb98a7229815109072 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072 2023-11-03 13:55:42,877 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:55:42,893 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:55:42,894 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 46cdc5862837157d20f70fafedc327bc in 950ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:42,894 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:42,894 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:42,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:55:42,931 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645 2023-11-03 13:55:42,986 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/e428e637e73e4792bc0492afc2e5a8c7 2023-11-03 13:55:42,999 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/d604c7ad22fd491cbac6063b8a5930dd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd 2023-11-03 13:55:43,006 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:55:43,007 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/e428e637e73e4792bc0492afc2e5a8c7 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7 2023-11-03 13:55:43,032 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:55:43,033 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c349b5a83940e7ac1020a6ff54953bba in 1089ms, sequenceid=9, compaction requested=false 2023-11-03 13:55:43,033 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:43,033 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:43,033 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:55:43,034 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:55:43,034 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,034 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-03 13:55:43,034 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-03 13:55:43,035 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,036 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:43,036 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,036 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:43,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-03 13:55:43,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fd8fdc[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:43,038 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-03 13:55:43,038 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,039 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,039 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:43,042 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-03 13:55:43,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-03 13:55:43,043 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:43,044 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,044 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-03 13:55:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:43,044 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:43,044 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-03 13:55:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-03 13:55:43,055 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-03 13:55:43,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:43,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:43,055 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-03 13:55:43,055 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:43,064 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,065 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,065 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:43,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:43,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:43,067 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:43,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:43,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-03 13:55:43,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:43,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-03 13:55:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:43,073 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:43,073 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:43,074 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,074 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,074 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:43,074 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:43,174 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:43,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:43,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:43,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:43,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:43,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:43,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:43,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-03 13:55:43,194 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-03 13:55:43,194 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:43,194 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-03 13:55:43,195 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-03 13:55:43,195 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,195 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:43,196 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:43,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:43,197 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:43,197 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:43,197 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:43,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:43,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-03 13:55:43,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-03 13:55:43,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-03 13:55:43,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-03 13:55:43,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:43,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-03 13:55:43,210 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:43,210 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:43,211 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c1895869427f29144d076bec60ad1ba7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:55:43,214 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:43,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:55:43,214 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:43,214 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:43,214 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:43,215 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46cdc5862837157d20f70fafedc327bc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:55:43,214 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:43,215 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c349b5a83940e7ac1020a6ff54953bba 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:55:43,663 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 2023-11-03 13:55:43,678 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 2023-11-03 13:55:43,681 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 2023-11-03 13:55:43,719 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/001e8324df294cb18f9eed33aa58137c 2023-11-03 13:55:44,081 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/681f70e7ea2e41928ad2ed6d3be81317 2023-11-03 13:55:44,088 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/f5b3b4e0e8a04f429faa9bb05cfc906e 2023-11-03 13:55:44,108 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1 2023-11-03 13:55:44,131 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935 2023-11-03 13:55:44,151 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/1cb74d45609a48bcaeb95b51c1bd983c 2023-11-03 13:55:44,154 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe 2023-11-03 13:55:44,160 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/f5b3b4e0e8a04f429faa9bb05cfc906e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e 2023-11-03 13:55:44,165 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:55:44,165 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/1cb74d45609a48bcaeb95b51c1bd983c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c 2023-11-03 13:55:44,169 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:55:44,170 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c349b5a83940e7ac1020a6ff54953bba in 955ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:44,170 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:44,170 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:44,170 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:55:44,525 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/5c0c38a065f24dbeab06110b033c2797 2023-11-03 13:55:44,530 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/681f70e7ea2e41928ad2ed6d3be81317 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317 2023-11-03 13:55:44,533 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:55:44,534 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/5c0c38a065f24dbeab06110b033c2797 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797 2023-11-03 13:55:44,538 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:55:44,539 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 46cdc5862837157d20f70fafedc327bc in 1324ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:44,539 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:44,539 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:44,539 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:55:44,574 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/c351df6ccb99466cb33224a79a41fbcd 2023-11-03 13:55:44,583 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/001e8324df294cb18f9eed33aa58137c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c 2023-11-03 13:55:44,588 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:55:44,589 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/c351df6ccb99466cb33224a79a41fbcd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd 2023-11-03 13:55:44,603 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:55:44,604 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c1895869427f29144d076bec60ad1ba7 in 1394ms, sequenceid=13, compaction requested=true 2023-11-03 13:55:44,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:44,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:44,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:55:44,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:55:44,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-03 13:55:44,604 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-03 13:55:44,605 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,605 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:44,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:44,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-03 13:55:44,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e6e2f6c[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:44,607 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-03 13:55:44,607 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,608 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-03 13:55:44,608 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,608 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:44,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-03 13:55:44,608 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:44,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-03 13:55:44,610 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:44,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-03 13:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:44,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-03 13:55:44,617 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-03 13:55:44,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:44,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:44,617 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-03 13:55:44,617 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:44,630 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,630 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,630 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:44,631 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,633 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,637 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,637 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:44,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-03 13:55:44,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:44,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-03 13:55:44,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:44,638 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:44,638 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:44,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:44,739 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:44,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:44,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:44,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:44,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:55:44,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:44,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:44,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-03 13:55:44,745 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-03 13:55:44,745 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:44,745 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-03 13:55:44,745 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-03 13:55:44,745 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:44,746 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:44,746 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:44,747 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:44,747 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:44,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-03 13:55:44,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-03 13:55:44,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-03 13:55:44,749 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-03 13:55:44,749 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:44,749 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-03 13:55:44,749 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:44,749 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:44,749 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:44,749 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:55:44,750 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:44,749 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:44,750 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c1895869427f29144d076bec60ad1ba7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:55:44,750 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:44,750 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46cdc5862837157d20f70fafedc327bc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:55:44,750 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:44,750 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c349b5a83940e7ac1020a6ff54953bba 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:55:44,782 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 2023-11-03 13:55:45,180 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 2023-11-03 13:55:45,180 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 2023-11-03 13:55:45,192 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/98fc2bea3ff244bd93ff27eac66dbc2f 2023-11-03 13:55:45,585 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 2023-11-03 13:55:45,585 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/1977071189624a56b59eaad44a5f18fd 2023-11-03 13:55:45,601 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460 2023-11-03 13:55:45,605 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/19f1bad16336444dbcdbe0dee632b60c 2023-11-03 13:55:45,608 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff 2023-11-03 13:55:45,609 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 2023-11-03 13:55:45,613 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:55:45,613 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/19f1bad16336444dbcdbe0dee632b60c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c 2023-11-03 13:55:45,617 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:55:45,618 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c349b5a83940e7ac1020a6ff54953bba in 868ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:45,618 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:45,618 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:45,618 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:55:46,003 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba 2023-11-03 13:55:46,013 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/847ab53a7f5e4f5ab691268acd95564a 2023-11-03 13:55:46,029 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/98fc2bea3ff244bd93ff27eac66dbc2f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f 2023-11-03 13:55:46,031 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/56a0dd7ebccc4f44988b475404667050 2023-11-03 13:55:46,037 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:55:46,038 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/847ab53a7f5e4f5ab691268acd95564a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a 2023-11-03 13:55:46,049 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/1977071189624a56b59eaad44a5f18fd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd 2023-11-03 13:55:46,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:55:46,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:55:46,055 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c1895869427f29144d076bec60ad1ba7 in 1305ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:46,055 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:46,055 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:46,055 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:55:46,056 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/56a0dd7ebccc4f44988b475404667050 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050 2023-11-03 13:55:46,061 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:55:46,062 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 46cdc5862837157d20f70fafedc327bc in 1312ms, sequenceid=17, compaction requested=true 2023-11-03 13:55:46,062 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:46,062 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:46,062 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:55:46,062 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:55:46,062 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,062 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-03 13:55:46,063 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-03 13:55:46,067 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,067 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:46,068 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,068 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-03 13:55:46,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b219400[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:46,069 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-03 13:55:46,069 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,070 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,070 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-03 13:55:46,070 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-03 13:55:46,070 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:46,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,070 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:46,071 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:46,071 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-03 13:55:46,071 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:46,071 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-03 13:55:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:46,076 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-03 13:55:46,076 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:46,076 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:46,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-03 13:55:46,077 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-03 13:55:46,077 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:46,081 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,081 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:46,081 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:46,083 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,084 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:46,090 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,090 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,091 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:46,091 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:46,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-03 13:55:46,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:46,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-03 13:55:46,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:46,092 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:46,092 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:46,192 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:46,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:46,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:46,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699019746202 (current time:1699019746202). 2023-11-03 13:55:46,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-03 13:55:46,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] zookeeper.ReadOnlyZKClient(139): Connect 0x001babe5 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b384a76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:46,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:46,218 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:46,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x001babe5 to 127.0.0.1:53668 2023-11-03 13:55:46,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:46,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-03 13:55:46,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:46,233 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot, current working dir path: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/snaptb-1699019746193 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-03 13:55:46,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:46,243 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:46,244 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699020346244 2023-11-03 13:55:46,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:46,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699019746193 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-03 13:55:46,248 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:46,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-03 13:55:46,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 7 msec 2023-11-03 13:55:46,250 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-03 13:55:46,251 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699020346251 2023-11-03 13:55:46,254 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:46,254 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-03 13:55:46,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699019746193 2023-11-03 13:55:46,280 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699019746193' 2023-11-03 13:55:46,280 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-03 13:55:46,280 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699019746193' starting 'acquire' 2023-11-03 13:55:46,280 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699019746193', kicking off acquire phase on members. 2023-11-03 13:55:46,281 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,281 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699019746193 2023-11-03 13:55:46,282 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-03 13:55:46,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-03 13:55:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-03 13:55:46,282 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,282 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,282 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699019746193 2023-11-03 13:55:46,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-03 13:55:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699019746193 2023-11-03 13:55:46,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699019746193 from table testCompactionWithHFileLink type FLUSH 2023-11-03 13:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699019746193 2023-11-03 13:55:46,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699019746193' with timeout 300000ms 2023-11-03 13:55:46,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-03 13:55:46,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699019746193' starting 'acquire' stage 2023-11-03 13:55:46,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699019746193' locally acquired 2023-11-03 13:55:46,285 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (snaptb-1699019746193) in zk 2023-11-03 13:55:46,286 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,286 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-03 13:55:46,286 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,287 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699019746193' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'snaptb-1699019746193' on coordinator 2023-11-03 13:55:46,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f9ce3d[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:46,288 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699019746193' starting 'in-barrier' execution. 2023-11-03 13:55:46,288 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,289 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,289 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699019746193' received 'reached' from coordinator. 2023-11-03 13:55:46,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,289 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:46,290 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:46,291 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:46,291 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:46,292 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.' region-info for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,294 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:46,294 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:46,294 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:46,294 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-03 13:55:46,294 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:46,295 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-03 13:55:46,294 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:46,295 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.' region-info for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,295 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:46,295 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.' region-info for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,297 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-03 13:55:46,297 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-03 13:55:46,297 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd] hfiles 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0] hfiles 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f] hfiles 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,300 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050] hfiles 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c] hfiles 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a] hfiles 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,305 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050 for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,315 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. completed. 2023-11-03 13:55:46,315 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:46,316 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-03 13:55:46,355 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:46,359 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-03 13:55:46,560 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:46,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:46,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:46,561 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-03 13:55:46,717 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. completed. 2023-11-03 13:55:46,717 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:46,717 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-03 13:55:46,717 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. completed. 2023-11-03 13:55:46,717 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:46,717 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-03 13:55:46,717 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-03 13:55:46,717 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699019746193' locally completed 2023-11-03 13:55:46,718 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699019746193' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:46,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699019746193' has notified controller of completion 2023-11-03 13:55:46,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,719 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699019746193' completed. 2023-11-03 13:55:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-03 13:55:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699019746193' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:46,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'snaptb-1699019746193', counting down latch. Waiting for 0 more 2023-11-03 13:55:46,724 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699019746193' execution completed 2023-11-03 13:55:46,724 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:46,725 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:46,725 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699019746193 2023-11-03 13:55:46,725 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699019746193including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-03 13:55:46,731 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,731 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-03 13:55:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,731 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-03 13:55:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:46,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-03 13:55:46,732 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-03 13:55:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:46,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,734 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699019746193 2023-11-03 13:55:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-03 13:55:46,739 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699019746193 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699019746193 2023-11-03 13:55:46,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699019746193 2023-11-03 13:55:46,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1699019746193 because node does not exist (not an error) 2023-11-03 13:55:46,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-03 13:55:46,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-03 13:55:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-03 13:55:46,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699019746193/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:46,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699019746193 2023-11-03 13:55:46,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-03 13:55:46,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699019746193 2023-11-03 13:55:46,740 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699019746193 2023-11-03 13:55:46,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-03 13:55:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-03 13:55:46,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812] mob files 2023-11-03 13:55:46,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b 2023-11-03 13:55:46,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1] mob files 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927 2023-11-03 13:55:46,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1 2023-11-03 13:55:46,861 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:46,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:46,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:46,862 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-03 13:55:47,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699019746193 2023-11-03 13:55:47,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/snaptb-1699019746193 2023-11-03 13:55:47,362 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:47,364 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-03 13:55:47,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/snaptb-1699019746193 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/snaptb-1699019746193 2023-11-03 13:55:47,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699019746193 of table testCompactionWithHFileLink completed 2023-11-03 13:55:47,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/snaptb-1699019746193 2023-11-03 13:55:47,702 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/snaptb-1699019746193 2023-11-03 13:55:47,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699019746193 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699019746246Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699019747150 (+904 ms)Consolidate snapshot: snaptb-1699019746193 at 1699019747150Loading Region manifests for snaptb-1699019746193 at 1699019747150Writing data manifest for snaptb-1699019746193 at 1699019747163 (+13 ms)Verifying snapshot: snaptb-1699019746193 at 1699019747589 (+426 ms)Snapshot snaptb-1699019746193 of table testCompactionWithHFileLink completed at 1699019747699 (+110 ms) 2023-11-03 13:55:47,704 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-03 13:55:47,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.4560 sec 2023-11-03 13:55:48,365 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:48,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:48,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-03 13:55:48,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:55:48,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-03 13:55:48,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-03 13:55:48,419 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-03 13:55:48,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:48,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-03 13:55:48,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-03 13:55:48,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:48,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:48,420 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:48,420 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:48,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:48,421 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:48,421 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:48,421 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-03 13:55:48,422 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-03 13:55:48,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-03 13:55:48,422 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-03 13:55:48,422 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:55:48,422 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-03 13:55:48,422 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:48,422 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. started... 2023-11-03 13:55:48,422 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:48,422 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. started... 2023-11-03 13:55:48,422 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c1895869427f29144d076bec60ad1ba7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:55:48,422 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46cdc5862837157d20f70fafedc327bc 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:55:48,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:55:48,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:55:48,426 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:48,426 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. started... 2023-11-03 13:55:48,427 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c349b5a83940e7ac1020a6ff54953bba 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:55:48,468 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/fa64c4cfbd16488d88f890708b16be5e 2023-11-03 13:55:48,474 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa64c4cfbd16488d88f890708b16be5e 2023-11-03 13:55:48,875 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/6d93910237724ca6a6c52508266651a1 2023-11-03 13:55:48,889 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d93910237724ca6a6c52508266651a1 2023-11-03 13:55:49,308 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/3ccdf62636ee4cb7838bc501ad74a070 2023-11-03 13:55:49,312 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ccdf62636ee4cb7838bc501ad74a070 2023-11-03 13:55:49,325 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/27450db5e864492ea5e7e6a5d57036bd 2023-11-03 13:55:49,333 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27450db5e864492ea5e7e6a5d57036bd 2023-11-03 13:55:49,336 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/fa64c4cfbd16488d88f890708b16be5e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e 2023-11-03 13:55:49,350 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/2f04cd6dc0224867871f2d08ec04ac50 2023-11-03 13:55:49,368 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f04cd6dc0224867871f2d08ec04ac50 2023-11-03 13:55:49,372 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/6d93910237724ca6a6c52508266651a1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1 2023-11-03 13:55:49,372 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa64c4cfbd16488d88f890708b16be5e 2023-11-03 13:55:49,372 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e, entries=3, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:49,374 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/27450db5e864492ea5e7e6a5d57036bd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd 2023-11-03 13:55:49,381 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d93910237724ca6a6c52508266651a1 2023-11-03 13:55:49,381 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1, entries=3, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:49,382 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/2f04cd6dc0224867871f2d08ec04ac50 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50 2023-11-03 13:55:49,384 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27450db5e864492ea5e7e6a5d57036bd 2023-11-03 13:55:49,384 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd, entries=1, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:49,386 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 46cdc5862837157d20f70fafedc327bc in 963ms, sequenceid=24, compaction requested=true 2023-11-03 13:55:49,386 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:49,386 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:49,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:55:49,415 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f04cd6dc0224867871f2d08ec04ac50 2023-11-03 13:55:49,415 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50, entries=1, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:49,416 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c1895869427f29144d076bec60ad1ba7 in 994ms, sequenceid=24, compaction requested=true 2023-11-03 13:55:49,417 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:49,417 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:49,417 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:55:50,140 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/fa438b09c841419bbeef24481450acd9 2023-11-03 13:55:50,157 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa438b09c841419bbeef24481450acd9 2023-11-03 13:55:50,157 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/3ccdf62636ee4cb7838bc501ad74a070 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070 2023-11-03 13:55:50,165 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ccdf62636ee4cb7838bc501ad74a070 2023-11-03 13:55:50,165 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070, entries=3, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:50,167 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/fa438b09c841419bbeef24481450acd9 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9 2023-11-03 13:55:50,177 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa438b09c841419bbeef24481450acd9 2023-11-03 13:55:50,177 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9, entries=1, sequenceid=24, filesize=5.0 K 2023-11-03 13:55:50,178 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c349b5a83940e7ac1020a6ff54953bba in 1751ms, sequenceid=24, compaction requested=true 2023-11-03 13:55:50,178 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:50,178 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:50,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:55:50,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:55:50,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-03 13:55:50,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-03 13:55:50,185 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,186 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:50,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-03 13:55:50,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@254f2091[Count = 0] remaining members to acquire global barrier 2023-11-03 13:55:50,189 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-03 13:55:50,189 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,189 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,189 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:55:50,198 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,198 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:55:50,202 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-03 13:55:50,203 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-03 13:55:50,203 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:55:50,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-03 13:55:50,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:50,206 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-03 13:55:50,209 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:50,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:55:50,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-03 13:55:50,212 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-03 13:55:50,212 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:55:50,212 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:55:50,212 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-03 13:55:50,212 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:55:50,216 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:55:50,217 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,217 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:50,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:55:50,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,228 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:55:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-03 13:55:50,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-03 13:55:50,269 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-03 13:55:50,269 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:55:50,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-03 13:55:50,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:55:50,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:55:50,270 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:55:50,274 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:50,274 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:55:50,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:55:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:55:50,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:55:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:55:50,374 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:55:50,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:55:50,377 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:50,377 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c1895869427f29144d076bec60ad1ba7/family1 is initiating major compaction (all files) 2023-11-03 13:55:50,377 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:50,377 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:50,377 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c1895869427f29144d076bec60ad1ba7/family1 in testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:50,377 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp, totalSize=26.7 K 2023-11-03 13:55:50,378 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting d702b2dae9494e308f56c080fc8a715c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739994 2023-11-03 13:55:50,379 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3fa62a6697f944168b9cb04ef69e95fc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:55:50,379 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 001e8324df294cb18f9eed33aa58137c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:55:50,380 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 98fc2bea3ff244bd93ff27eac66dbc2f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:55:50,380 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 6d93910237724ca6a6c52508266651a1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:50,415 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c1895869427f29144d076bec60ad1ba7#family1#compaction#107 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:50,843 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del 2023-11-03 13:55:50,844 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del 2023-11-03 13:55:51,716 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30f0244dfa5249f6b4205f6d61f418c5 2023-11-03 13:55:51,718 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/30f0244dfa5249f6b4205f6d61f418c5 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/30f0244dfa5249f6b4205f6d61f418c5 2023-11-03 13:55:51,740 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30f0244dfa5249f6b4205f6d61f418c5 2023-11-03 13:55:51,741 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c1895869427f29144d076bec60ad1ba7/family1 of c1895869427f29144d076bec60ad1ba7 into 30f0244dfa5249f6b4205f6d61f418c5(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:55:51,741 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:51,741 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:51,742 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c1895869427f29144d076bec60ad1ba7/family2 is initiating major compaction (all files) 2023-11-03 13:55:51,742 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:51,742 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:51,742 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c1895869427f29144d076bec60ad1ba7/family2 in testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:51,742 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp, totalSize=25.4 K 2023-11-03 13:55:51,743 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 394adb639ec6484e9678e5c2173893d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739994 2023-11-03 13:55:51,747 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 53ac5f61bd52429690a87e9444a57c60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:55:51,749 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting c351df6ccb99466cb33224a79a41fbcd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:55:51,752 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 847ab53a7f5e4f5ab691268acd95564a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:55:51,755 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 2f04cd6dc0224867871f2d08ec04ac50, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:51,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1] to archive 2023-11-03 13:55:51,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:51,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/d702b2dae9494e308f56c080fc8a715c 2023-11-03 13:55:51,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/3fa62a6697f944168b9cb04ef69e95fc 2023-11-03 13:55:51,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/001e8324df294cb18f9eed33aa58137c 2023-11-03 13:55:51,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/98fc2bea3ff244bd93ff27eac66dbc2f 2023-11-03 13:55:51,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/6d93910237724ca6a6c52508266651a1 2023-11-03 13:55:51,818 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c1895869427f29144d076bec60ad1ba7#family2#compaction#108 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:51,864 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del 2023-11-03 13:55:51,864 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del 2023-11-03 13:55:51,893 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 330aa140c9df4afa87ad2ba1684f3467 2023-11-03 13:55:51,894 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/330aa140c9df4afa87ad2ba1684f3467 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/330aa140c9df4afa87ad2ba1684f3467 2023-11-03 13:55:51,902 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 330aa140c9df4afa87ad2ba1684f3467 2023-11-03 13:55:51,906 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c1895869427f29144d076bec60ad1ba7/family2 of c1895869427f29144d076bec60ad1ba7 into 330aa140c9df4afa87ad2ba1684f3467(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:51,906 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:51,906 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:51,906 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 46cdc5862837157d20f70fafedc327bc/family1 is initiating major compaction (all files) 2023-11-03 13:55:51,907 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:51,907 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:51,907 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 46cdc5862837157d20f70fafedc327bc/family1 in testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:51,907 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp, totalSize=26.7 K 2023-11-03 13:55:51,908 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 6f25fa054ca34fb59c2240fb9b1370b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739993 2023-11-03 13:55:51,908 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 261e6ad667ce40afa2f2ae6a3bec3a38, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741874 2023-11-03 13:55:51,913 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 681f70e7ea2e41928ad2ed6d3be81317, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743176 2023-11-03 13:55:51,914 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 1977071189624a56b59eaad44a5f18fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744740 2023-11-03 13:55:51,926 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting fa64c4cfbd16488d88f890708b16be5e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:51,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50] to archive 2023-11-03 13:55:51,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:52,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/394adb639ec6484e9678e5c2173893d1 2023-11-03 13:55:52,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/53ac5f61bd52429690a87e9444a57c60 2023-11-03 13:55:52,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/c351df6ccb99466cb33224a79a41fbcd 2023-11-03 13:55:52,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/847ab53a7f5e4f5ab691268acd95564a 2023-11-03 13:55:52,073 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 46cdc5862837157d20f70fafedc327bc#family1#compaction#109 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:52,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/2f04cd6dc0224867871f2d08ec04ac50 2023-11-03 13:55:52,151 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del 2023-11-03 13:55:52,151 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del 2023-11-03 13:55:52,650 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9b6d34331124b94a9542d96111fe5ec 2023-11-03 13:55:52,652 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/e9b6d34331124b94a9542d96111fe5ec as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e9b6d34331124b94a9542d96111fe5ec 2023-11-03 13:55:52,673 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9b6d34331124b94a9542d96111fe5ec 2023-11-03 13:55:52,675 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46cdc5862837157d20f70fafedc327bc/family1 of 46cdc5862837157d20f70fafedc327bc into e9b6d34331124b94a9542d96111fe5ec(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:52,675 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:52,675 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:52,675 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 46cdc5862837157d20f70fafedc327bc/family2 is initiating major compaction (all files) 2023-11-03 13:55:52,675 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:52,675 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:52,675 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 46cdc5862837157d20f70fafedc327bc/family2 in testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:52,676 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp, totalSize=25.4 K 2023-11-03 13:55:52,676 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 469fb41cfc054cf3a4dcab4b2bc4766d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739993 2023-11-03 13:55:52,678 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 969238407e7349cb98a7229815109072, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741874 2023-11-03 13:55:52,679 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 5c0c38a065f24dbeab06110b033c2797, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743176 2023-11-03 13:55:52,680 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 56a0dd7ebccc4f44988b475404667050, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744740 2023-11-03 13:55:52,680 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 27450db5e864492ea5e7e6a5d57036bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:52,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e] to archive 2023-11-03 13:55:52,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:52,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/6f25fa054ca34fb59c2240fb9b1370b9 2023-11-03 13:55:52,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/261e6ad667ce40afa2f2ae6a3bec3a38 2023-11-03 13:55:52,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/681f70e7ea2e41928ad2ed6d3be81317 2023-11-03 13:55:52,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/1977071189624a56b59eaad44a5f18fd 2023-11-03 13:55:52,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/fa64c4cfbd16488d88f890708b16be5e 2023-11-03 13:55:52,774 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 46cdc5862837157d20f70fafedc327bc#family2#compaction#110 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:52,802 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del 2023-11-03 13:55:52,802 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del 2023-11-03 13:55:52,885 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46923445ac8848dba2df0330c25ae145 2023-11-03 13:55:52,887 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/46923445ac8848dba2df0330c25ae145 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/46923445ac8848dba2df0330c25ae145 2023-11-03 13:55:52,895 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46923445ac8848dba2df0330c25ae145 2023-11-03 13:55:52,899 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46cdc5862837157d20f70fafedc327bc/family2 of 46cdc5862837157d20f70fafedc327bc into 46923445ac8848dba2df0330c25ae145(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:52,900 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:52,900 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:52,900 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c349b5a83940e7ac1020a6ff54953bba/family1 is initiating major compaction (all files) 2023-11-03 13:55:52,900 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:52,900 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:52,900 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c349b5a83940e7ac1020a6ff54953bba/family1 in testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:52,901 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp, totalSize=26.7 K 2023-11-03 13:55:52,901 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting a08b2d1b997e499a9307c709dc2ab73a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739995 2023-11-03 13:55:52,907 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting d604c7ad22fd491cbac6063b8a5930dd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:55:52,911 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting f5b3b4e0e8a04f429faa9bb05cfc906e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:55:52,915 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 7b5c4f94e7b042d0b0735d3bb37e40a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:55:52,915 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3ccdf62636ee4cb7838bc501ad74a070, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:52,967 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c349b5a83940e7ac1020a6ff54953bba#family1#compaction#111 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:52,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd] to archive 2023-11-03 13:55:52,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:53,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/469fb41cfc054cf3a4dcab4b2bc4766d 2023-11-03 13:55:53,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/969238407e7349cb98a7229815109072 2023-11-03 13:55:53,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/5c0c38a065f24dbeab06110b033c2797 2023-11-03 13:55:53,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/56a0dd7ebccc4f44988b475404667050 2023-11-03 13:55:53,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/27450db5e864492ea5e7e6a5d57036bd 2023-11-03 13:55:53,447 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del 2023-11-03 13:55:53,447 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del 2023-11-03 13:55:53,531 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85db3bcb27644c5392a97a9fb5ebffc6 2023-11-03 13:55:53,532 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/85db3bcb27644c5392a97a9fb5ebffc6 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/85db3bcb27644c5392a97a9fb5ebffc6 2023-11-03 13:55:53,543 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85db3bcb27644c5392a97a9fb5ebffc6 2023-11-03 13:55:53,547 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c349b5a83940e7ac1020a6ff54953bba/family1 of c349b5a83940e7ac1020a6ff54953bba into 85db3bcb27644c5392a97a9fb5ebffc6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:55:53,547 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:53,547 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:55:53,547 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c349b5a83940e7ac1020a6ff54953bba/family2 is initiating major compaction (all files) 2023-11-03 13:55:53,547 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:55:53,548 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:55:53,548 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c349b5a83940e7ac1020a6ff54953bba/family2 in testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:53,548 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp, totalSize=25.4 K 2023-11-03 13:55:53,549 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 6f4ea4d72a184fe39e2b3f58ab3f7c9b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739995 2023-11-03 13:55:53,554 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting e428e637e73e4792bc0492afc2e5a8c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:55:53,557 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 1cb74d45609a48bcaeb95b51c1bd983c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:55:53,558 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 19f1bad16336444dbcdbe0dee632b60c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:55:53,558 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting fa438b09c841419bbeef24481450acd9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-03 13:55:53,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070] to archive 2023-11-03 13:55:53,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:53,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/a08b2d1b997e499a9307c709dc2ab73a 2023-11-03 13:55:53,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/d604c7ad22fd491cbac6063b8a5930dd 2023-11-03 13:55:53,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/f5b3b4e0e8a04f429faa9bb05cfc906e 2023-11-03 13:55:53,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/7b5c4f94e7b042d0b0735d3bb37e40a0 2023-11-03 13:55:53,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/3ccdf62636ee4cb7838bc501ad74a070 2023-11-03 13:55:53,689 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c349b5a83940e7ac1020a6ff54953bba#family2#compaction#112 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:55:54,135 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del 2023-11-03 13:55:54,136 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del 2023-11-03 13:55:54,557 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee3e00ae2da14945891f8ab284f91d6c 2023-11-03 13:55:54,558 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/ee3e00ae2da14945891f8ab284f91d6c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/ee3e00ae2da14945891f8ab284f91d6c 2023-11-03 13:55:54,563 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee3e00ae2da14945891f8ab284f91d6c 2023-11-03 13:55:54,565 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c349b5a83940e7ac1020a6ff54953bba/family2 of c349b5a83940e7ac1020a6ff54953bba into ee3e00ae2da14945891f8ab284f91d6c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:55:54,565 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:54,571 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:55:54,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9] to archive 2023-11-03 13:55:54,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:54,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/6f4ea4d72a184fe39e2b3f58ab3f7c9b 2023-11-03 13:55:54,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/e428e637e73e4792bc0492afc2e5a8c7 2023-11-03 13:55:54,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/1cb74d45609a48bcaeb95b51c1bd983c 2023-11-03 13:55:54,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/19f1bad16336444dbcdbe0dee632b60c 2023-11-03 13:55:54,595 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:55:54,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/fa438b09c841419bbeef24481450acd9 2023-11-03 13:55:54,604 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:55:54,606 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:55:54,624 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:55:54,733 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-03 13:55:54,737 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del 2023-11-03 13:55:54,741 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del 2023-11-03 13:55:54,746 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del 2023-11-03 13:55:54,746 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:54,747 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(139): Connect 0x76e0b88e to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:54,751 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504e0700, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:54,751 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:54,751 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:54,754 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:54,874 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6 2023-11-03 13:55:54,890 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:54,907 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:54,924 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:54,987 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:55:54,988 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8 2023-11-03 13:55:54,989 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:54,991 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:55:55,041 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/6e4123657da045eeae8fc77fc928466c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-03 13:55:55,043 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/6e4123657da045eeae8fc77fc928466c}] 2023-11-03 13:55:55,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/6e4123657da045eeae8fc77fc928466c for inclusion in 46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:55:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-03 13:55:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last=1 2023-11-03 13:55:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:55,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/6e4123657da045eeae8fc77fc928466c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__unmmrvb0m5v9irf2pp1shhne9obe74nt8q43brk11sf8f4dv7klc3o0t92rmrlc9/family1/6e4123657da045eeae8fc77fc928466c 2023-11-03 13:55:55,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__unmmrvb0m5v9irf2pp1shhne9obe74nt8q43brk11sf8f4dv7klc3o0t92rmrlc9/family1/6e4123657da045eeae8fc77fc928466c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ 2023-11-03 13:55:55,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__unmmrvb0m5v9irf2pp1shhne9obe74nt8q43brk11sf8f4dv7klc3o0t92rmrlc9/family1/6e4123657da045eeae8fc77fc928466c into 46cdc5862837157d20f70fafedc327bc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ - updating store file list. 2023-11-03 13:55:55,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ into 46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:55:55,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__unmmrvb0m5v9irf2pp1shhne9obe74nt8q43brk11sf8f4dv7klc3o0t92rmrlc9/family1/6e4123657da045eeae8fc77fc928466c into 46cdc5862837157d20f70fafedc327bc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_) 2023-11-03 13:55:55,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/5f0b5ea7a300478daae87b79d2389a3c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-03 13:55:55,151 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/5f0b5ea7a300478daae87b79d2389a3c}] 2023-11-03 13:55:55,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__unmmrvb0m5v9irf2pp1shhne9obe74nt8q43brk11sf8f4dv7klc3o0t92rmrlc9/family1/6e4123657da045eeae8fc77fc928466c 2023-11-03 13:55:55,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/5f0b5ea7a300478daae87b79d2389a3c for inclusion in c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:55:55,184 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:55,191 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-03 13:55:55,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-03 13:55:55,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:55,203 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 2023-11-03 13:55:55,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/5f0b5ea7a300478daae87b79d2389a3c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__tlvuumhogbnv6frjmmm6qeh5o6u47i2ug834u47n4sje77g2c4tn5p5k51sekrv7/family1/5f0b5ea7a300478daae87b79d2389a3c 2023-11-03 13:55:55,208 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 2023-11-03 13:55:55,215 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b 2023-11-03 13:55:55,229 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 2023-11-03 13:55:55,229 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:55:55,229 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103' 2023-11-03 13:55:55,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__tlvuumhogbnv6frjmmm6qeh5o6u47i2ug834u47n4sje77g2c4tn5p5k51sekrv7/family1/5f0b5ea7a300478daae87b79d2389a3c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ 2023-11-03 13:55:55,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__tlvuumhogbnv6frjmmm6qeh5o6u47i2ug834u47n4sje77g2c4tn5p5k51sekrv7/family1/5f0b5ea7a300478daae87b79d2389a3c into c1895869427f29144d076bec60ad1ba7/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ - updating store file list. 2023-11-03 13:55:55,239 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:55,290 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ into c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:55:55,290 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__tlvuumhogbnv6frjmmm6qeh5o6u47i2ug834u47n4sje77g2c4tn5p5k51sekrv7/family1/5f0b5ea7a300478daae87b79d2389a3c into c1895869427f29144d076bec60ad1ba7/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_) 2023-11-03 13:55:55,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__tlvuumhogbnv6frjmmm6qeh5o6u47i2ug834u47n4sje77g2c4tn5p5k51sekrv7/family1/5f0b5ea7a300478daae87b79d2389a3c 2023-11-03 13:55:55,322 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:55,323 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,359 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 2023-11-03 13:55:55,375 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 2023-11-03 13:55:55,398 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad 2023-11-03 13:55:55,410 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 2023-11-03 13:55:55,410 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:55:55,410 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103' 2023-11-03 13:55:55,414 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:55,435 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79 2023-11-03 13:55:55,446 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:55,570 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/d714eced07dd4d419a7b6191f65cd0dc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-03 13:55:55,578 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/d714eced07dd4d419a7b6191f65cd0dc}] 2023-11-03 13:55:55,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/d714eced07dd4d419a7b6191f65cd0dc for inclusion in c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:55:55,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-03 13:55:55,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-03 13:55:55,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/d714eced07dd4d419a7b6191f65cd0dc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phb2u1oonoheirkcbofd88gj9re9gb0go9eeve3m4vp6oujk5e5rhif45nb3b9d0/family1/d714eced07dd4d419a7b6191f65cd0dc 2023-11-03 13:55:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phb2u1oonoheirkcbofd88gj9re9gb0go9eeve3m4vp6oujk5e5rhif45nb3b9d0/family1/d714eced07dd4d419a7b6191f65cd0dc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ 2023-11-03 13:55:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phb2u1oonoheirkcbofd88gj9re9gb0go9eeve3m4vp6oujk5e5rhif45nb3b9d0/family1/d714eced07dd4d419a7b6191f65cd0dc into c349b5a83940e7ac1020a6ff54953bba/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ - updating store file list. 2023-11-03 13:55:55,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ into c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:55:55,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phb2u1oonoheirkcbofd88gj9re9gb0go9eeve3m4vp6oujk5e5rhif45nb3b9d0/family1/d714eced07dd4d419a7b6191f65cd0dc into c349b5a83940e7ac1020a6ff54953bba/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_) 2023-11-03 13:55:55,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phb2u1oonoheirkcbofd88gj9re9gb0go9eeve3m4vp6oujk5e5rhif45nb3b9d0/family1/d714eced07dd4d419a7b6191f65cd0dc 2023-11-03 13:55:55,646 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:55,647 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,649 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 2023-11-03 13:55:55,650 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 2023-11-03 13:55:55,652 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 2023-11-03 13:55:55,654 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 2023-11-03 13:55:55,654 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:55:55,654 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103' 2023-11-03 13:55:55,655 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:55,655 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:55:55,655 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:55:55,655 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del] 2023-11-03 13:55:55,656 DEBUG [Listener at localhost/39963] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,658 DEBUG [Listener at localhost/39963] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103c56517b7854f4ea988352fa5304c728d_del 2023-11-03 13:55:55,658 INFO [Listener at localhost/39963] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-03 13:55:55,658 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del] 2023-11-03 13:55:55,660 DEBUG [Listener at localhost/39963] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,664 DEBUG [Listener at localhost/39963] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110325db83f81fc34093968175e29bcd2f0e_del 2023-11-03 13:55:55,665 INFO [Listener at localhost/39963] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-03 13:55:55,665 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del] 2023-11-03 13:55:55,665 DEBUG [Listener at localhost/39963] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:55:55,671 DEBUG [Listener at localhost/39963] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103004483c0d62447bbb573864946170a6e_del 2023-11-03 13:55:55,671 INFO [Listener at localhost/39963] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-03 13:55:55,687 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:55:55,701 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:55:55,719 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:55:55,724 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:55:55,743 INFO [Listener at localhost/39963] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-03 13:55:55,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-11-03 13:55:55,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-03 13:55:55,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019755749"}]},"ts":"1699019755749"} 2023-11-03 13:55:55,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-03 13:55:55,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-03 13:55:55,758 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-03 13:55:55,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, UNASSIGN}] 2023-11-03 13:55:55,760 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, UNASSIGN 2023-11-03 13:55:55,761 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, UNASSIGN 2023-11-03 13:55:55,761 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, UNASSIGN 2023-11-03 13:55:55,762 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:55,762 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:55,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019755762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019755762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019755762"}]},"ts":"1699019755762"} 2023-11-03 13:55:55,762 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019755762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019755762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019755762"}]},"ts":"1699019755762"} 2023-11-03 13:55:55,763 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:55,763 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019755763"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019755763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019755763"}]},"ts":"1699019755763"} 2023-11-03 13:55:55,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:55,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:55,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:55:55,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-03 13:55:55,917 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:55:55,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:55,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 46cdc5862837157d20f70fafedc327bc, disabling compactions & flushes 2023-11-03 13:55:55,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:55,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:55,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. after waiting 0 ms 2023-11-03 13:55:55,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:56,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-03 13:55:56,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:55:56,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:55:56,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=CLOSED 2023-11-03 13:55:56,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019756015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019756015"}]},"ts":"1699019756015"} 2023-11-03 13:55:56,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:56,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:56,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c1895869427f29144d076bec60ad1ba7, disabling compactions & flushes 2023-11-03 13:55:56,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:56,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:56,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. after waiting 0 ms 2023-11-03 13:55:56,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:56,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-11-03 13:55:56,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288 in 251 msec 2023-11-03 13:55:56,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, UNASSIGN in 270 msec 2023-11-03 13:55:56,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-03 13:55:56,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:55:56,064 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=CLOSED 2023-11-03 13:55:56,064 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019756064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019756064"}]},"ts":"1699019756064"} 2023-11-03 13:55:56,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:56,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:56,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c349b5a83940e7ac1020a6ff54953bba, disabling compactions & flushes 2023-11-03 13:55:56,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:56,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:56,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. after waiting 0 ms 2023-11-03 13:55:56,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:56,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-03 13:55:56,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=90 2023-11-03 13:55:56,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288 in 312 msec 2023-11-03 13:55:56,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, UNASSIGN in 332 msec 2023-11-03 13:55:56,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-03 13:55:56,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:55:56,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:55:56,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:56,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=CLOSED 2023-11-03 13:55:56,171 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019756170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019756170"}]},"ts":"1699019756170"} 2023-11-03 13:55:56,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-03 13:55:56,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288 in 422 msec 2023-11-03 13:55:56,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-11-03 13:55:56,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, UNASSIGN in 441 msec 2023-11-03 13:55:56,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019756209"}]},"ts":"1699019756209"} 2023-11-03 13:55:56,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-03 13:55:56,253 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-03 13:55:56,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 511 msec 2023-11-03 13:55:56,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-03 13:55:56,386 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-03 13:55:56,418 INFO [Listener at localhost/39963] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:56,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699019756420 (current time:1699019756420). 2023-11-03 13:55:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-03 13:55:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] zookeeper.ReadOnlyZKClient(139): Connect 0x6dc5673b to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:55:56,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c9dc00f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:55:56,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:55:56,492 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:55:56,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dc5673b to 127.0.0.1:53668 2023-11-03 13:55:56,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:55:56,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-03 13:55:56,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:56,507 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot, current working dir path: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699019746193-1699019756418 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-03 13:55:56,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:56,515 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:56,516 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699020356516 2023-11-03 13:55:56,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699019746193-1699019756418 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-03 13:55:56,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:56,518 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-03 13:55:56,519 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-03 13:55:56,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-03 13:55:56,582 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-03 13:55:56,582 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-03 13:55:56,595 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-03 13:55:56,595 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-03 13:55:56,598 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-03 13:55:56,598 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-03 13:55:56,598 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-03 13:55:56,598 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-03 13:55:56,619 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:56,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:56,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:56,627 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-03 13:55:56,630 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6] hfiles 2023-11-03 13:55:56,631 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8 2023-11-03 13:55:56,631 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79 2023-11-03 13:55:56,631 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6 2023-11-03 13:55:56,658 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/85db3bcb27644c5392a97a9fb5ebffc6] hfiles 2023-11-03 13:55:56,658 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ 2023-11-03 13:55:56,658 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/85db3bcb27644c5392a97a9fb5ebffc6 2023-11-03 13:55:56,661 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e9b6d34331124b94a9542d96111fe5ec] hfiles 2023-11-03 13:55:56,662 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ 2023-11-03 13:55:56,662 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e9b6d34331124b94a9542d96111fe5ec 2023-11-03 13:55:56,663 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/ee3e00ae2da14945891f8ab284f91d6c] hfiles 2023-11-03 13:55:56,663 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/ee3e00ae2da14945891f8ab284f91d6c 2023-11-03 13:55:56,665 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/46923445ac8848dba2df0330c25ae145] hfiles 2023-11-03 13:55:56,665 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/46923445ac8848dba2df0330c25ae145 2023-11-03 13:55:56,666 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/30f0244dfa5249f6b4205f6d61f418c5, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_] hfiles 2023-11-03 13:55:56,666 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/30f0244dfa5249f6b4205f6d61f418c5 2023-11-03 13:55:56,666 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ 2023-11-03 13:55:56,671 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/330aa140c9df4afa87ad2ba1684f3467] hfiles 2023-11-03 13:55:56,671 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/330aa140c9df4afa87ad2ba1684f3467 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1] hfiles 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311038f6c2401199a4b8a92f350dbab673bbe 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103a83d730bce034277b1724f0d393b320c 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103b16484c18cf84898ac46cb9c31a79457 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103eaf45fa30c1f459995a81dad41a88eff 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030959f555cb2947e8ae9efaa619773935 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del 2023-11-03 13:55:56,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110354093215db4c4fadbbc9a81b1516a645 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103881773435a634379898d92f009e29460 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231103de49ecb7874e4406932f7bf443e4796a 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311032153e1e2fb2f4bb9acade5b4e92006ba 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103407398988dd448a5b10b1fd99e6afac1 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311034abe0184b8eb4253ae3fd1cdd026b927 2023-11-03 13:55:56,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231103d160e1bf9c694b44b7afc51e735ee9e1 2023-11-03 13:55:56,830 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:56,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:56,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:56,835 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-03 13:55:57,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-03 13:55:57,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:57,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:57,138 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:57,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:57,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:57,140 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-03 13:55:57,642 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:57,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:57,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-03 13:55:57,651 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-03 13:55:57,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699019746193-1699019756418 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:57,714 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699019746193-1699019756418 of table testCompactionWithHFileLink completed 2023-11-03 13:55:57,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:57,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:57,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699019746193-1699019756418 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699019756518Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699019756568 (+50 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699019746193-1699019756418 at 1699019757122 (+554 ms)Loading Region manifests for hbase-failsafe-snaptb-1699019746193-1699019756418 at 1699019757123 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1699019746193-1699019756418 at 1699019757143 (+20 ms)Verifying snapshot: hbase-failsafe-snaptb-1699019746193-1699019756418 at 1699019757575 (+432 ms)Snapshot hbase-failsafe-snaptb-1699019746193-1699019756418 of table testCompactionWithHFileLink completed at 1699019757714 (+139 ms) 2023-11-03 13:55:57,716 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-03 13:55:57,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2070 sec 2023-11-03 13:55:58,651 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-03 13:55:58,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-03 13:55:58,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699019746193-1699019756418 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-03 13:55:58,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699019746193" table: "testCompactionWithHFileLink" creation_time: 1699019746202 type: FLUSH version: 2 ttl: 0 ) 2023-11-03 13:55:58,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699019746193 as table=testCompactionWithHFileLink 2023-11-03 13:55:58,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-03 13:55:58,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-03 13:55:59,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-03 13:55:59,283 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:59,283 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-03 13:55:59,284 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-03 13:55:59,284 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-03 13:55:59,289 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699019746193" table: "testCompactionWithHFileLink" creation_time: 1699019746202 type: FLUSH version: 2 ttl: 0 2023-11-03 13:55:59,290 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink 2023-11-03 13:55:59,295 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-03 13:55:59,300 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103edcb0417b00347de9ba9279b17038cc8 2023-11-03 13:55:59,302 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103827698eb98984a60918dab15f0a58e79 2023-11-03 13:55:59,303 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110399fe526121f94c568175885bdf00e8b6 2023-11-03 13:55:59,303 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,307 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,311 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,314 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,320 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,323 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,329 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,339 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,343 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,346 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,350 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,353 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 of snapshot=snaptb-1699019746193 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-03 13:55:59,357 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110313b66fdcfb714a72a976a7e46b43bb9e_del 2023-11-03 13:55:59,359 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231103600517115f7b414eba22e0c0724e1fe8_del 2023-11-03 13:55:59,360 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311030c681d9a56cf4949859ad06ffdf9d12b_del 2023-11-03 13:55:59,360 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:55:59,360 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: c1895869427f29144d076bec60ad1ba7 2023-11-03 13:55:59,360 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:55:59,365 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e9b6d34331124b94a9542d96111fe5ec to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e9b6d34331124b94a9542d96111fe5ec 2023-11-03 13:55:59,366 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/85db3bcb27644c5392a97a9fb5ebffc6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/85db3bcb27644c5392a97a9fb5ebffc6 2023-11-03 13:55:59,368 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/30f0244dfa5249f6b4205f6d61f418c5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/30f0244dfa5249f6b4205f6d61f418c5 2023-11-03 13:55:59,369 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/a8005982fc0e4fc497cab41edefe4ba2_SeqId_29_ 2023-11-03 13:55:59,369 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f25fa054ca34fb59c2240fb9b1370b9 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,370 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/2348c0764af2426c9ed8949de01e1d4b_SeqId_29_ 2023-11-03 13:55:59,370 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a08b2d1b997e499a9307c709dc2ab73a of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,370 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/cf23a8c032164862bfe10bc365d5825d_SeqId_29_ 2023-11-03 13:55:59,370 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d702b2dae9494e308f56c080fc8a715c of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,381 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3fa62a6697f944168b9cb04ef69e95fc of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,382 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 261e6ad667ce40afa2f2ae6a3bec3a38 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,382 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d604c7ad22fd491cbac6063b8a5930dd of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,392 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 001e8324df294cb18f9eed33aa58137c of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,393 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f5b3b4e0e8a04f429faa9bb05cfc906e of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,394 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 681f70e7ea2e41928ad2ed6d3be81317 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,439 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 98fc2bea3ff244bd93ff27eac66dbc2f of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,440 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7b5c4f94e7b042d0b0735d3bb37e40a0 of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,440 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1977071189624a56b59eaad44a5f18fd of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-03 13:55:59,509 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/46923445ac8848dba2df0330c25ae145 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/46923445ac8848dba2df0330c25ae145 2023-11-03 13:55:59,509 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/330aa140c9df4afa87ad2ba1684f3467 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/330aa140c9df4afa87ad2ba1684f3467 2023-11-03 13:55:59,509 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 469fb41cfc054cf3a4dcab4b2bc4766d of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,509 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 394adb639ec6484e9678e5c2173893d1 of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,513 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/ee3e00ae2da14945891f8ab284f91d6c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/ee3e00ae2da14945891f8ab284f91d6c 2023-11-03 13:55:59,513 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f4ea4d72a184fe39e2b3f58ab3f7c9b of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,533 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 969238407e7349cb98a7229815109072 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,534 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 53ac5f61bd52429690a87e9444a57c60 of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,538 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e428e637e73e4792bc0492afc2e5a8c7 of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,549 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5c0c38a065f24dbeab06110b033c2797 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,552 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c351df6ccb99466cb33224a79a41fbcd of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,569 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1cb74d45609a48bcaeb95b51c1bd983c of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,591 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56a0dd7ebccc4f44988b475404667050 of snapshot=snaptb-1699019746193 to region=46cdc5862837157d20f70fafedc327bc table=testCompactionWithHFileLink 2023-11-03 13:55:59,602 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 847ab53a7f5e4f5ab691268acd95564a of snapshot=snaptb-1699019746193 to region=c1895869427f29144d076bec60ad1ba7 table=testCompactionWithHFileLink 2023-11-03 13:55:59,603 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 19f1bad16336444dbcdbe0dee632b60c of snapshot=snaptb-1699019746193 to region=c349b5a83940e7ac1020a6ff54953bba table=testCompactionWithHFileLink 2023-11-03 13:55:59,609 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699019746193" table: "testCompactionWithHFileLink" creation_time: 1699019746202 type: FLUSH version: 2 ttl: 0 2023-11-03 13:55:59,614 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699019759614"}]},"ts":"9223372036854775807"} 2023-11-03 13:55:59,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699019759614"}]},"ts":"9223372036854775807"} 2023-11-03 13:55:59,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699019759614"}]},"ts":"9223372036854775807"} 2023-11-03 13:55:59,621 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-03 13:55:59,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 46cdc5862837157d20f70fafedc327bc, NAME => 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c1895869427f29144d076bec60ad1ba7, NAME => 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => c349b5a83940e7ac1020a6ff54953bba, NAME => 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.', STARTKEY => '2', ENDKEY => ''}] 2023-11-03 13:55:59,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019759615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019759615"}]},"ts":"1699019759615"} 2023-11-03 13:55:59,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019759615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019759615"}]},"ts":"1699019759615"} 2023-11-03 13:55:59,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019759615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019759615"}]},"ts":"1699019759615"} 2023-11-03 13:55:59,625 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-03 13:55:59,625 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-03 13:55:59,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 46cdc5862837157d20f70fafedc327bc, NAME => 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c1895869427f29144d076bec60ad1ba7, NAME => 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => c349b5a83940e7ac1020a6ff54953bba, NAME => 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.', STARTKEY => '2', ENDKEY => ''}] 2023-11-03 13:55:59,626 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699019746193 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-03 13:55:59,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699019746193" table: "testCompactionWithHFileLink" creation_time: 1699019746202 type: FLUSH version: 2 ttl: 0 ) in 789 msec 2023-11-03 13:55:59,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-03 13:55:59,979 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-03 13:55:59,979 INFO [Listener at localhost/39963] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:55:59,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1699019746193-1699019756418" 2023-11-03 13:55:59,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699019746193-1699019756418 2023-11-03 13:56:00,010 INFO [Listener at localhost/39963] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-03 13:56:00,018 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-11-03 13:56:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-03 13:56:00,030 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-03 13:56:00,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019760030"}]},"ts":"1699019760030"} 2023-11-03 13:56:00,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-03 13:56:00,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-03 13:56:00,048 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-03 13:56:00,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN}] 2023-11-03 13:56:00,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN 2023-11-03 13:56:00,051 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN 2023-11-03 13:56:00,052 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN 2023-11-03 13:56:00,053 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-03 13:56:00,053 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-03 13:56:00,053 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-03 13:56:00,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-03 13:56:00,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019760210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019760210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019760210"}]},"ts":"1699019760210"} 2023-11-03 13:56:00,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019760210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019760210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019760210"}]},"ts":"1699019760210"} 2023-11-03 13:56:00,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019760210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019760210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019760210"}]},"ts":"1699019760210"} 2023-11-03 13:56:00,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:00,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:00,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:00,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-03 13:56:00,385 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:00,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46cdc5862837157d20f70fafedc327bc, NAME => 'testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.', STARTKEY => '', ENDKEY => '1'} 2023-11-03 13:56:00,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:00,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,396 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,397 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:56:00,397 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:56:00,398 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cdc5862837157d20f70fafedc327bc columnFamilyName family1 2023-11-03 13:56:00,416 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd 2023-11-03 13:56:00,429 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38 2023-11-03 13:56:00,436 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317 2023-11-03 13:56:00,454 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9 2023-11-03 13:56:00,454 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(310): Store=46cdc5862837157d20f70fafedc327bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:00,454 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,455 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2 2023-11-03 13:56:00,455 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2 2023-11-03 13:56:00,456 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cdc5862837157d20f70fafedc327bc columnFamilyName family2 2023-11-03 13:56:00,468 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d 2023-11-03 13:56:00,474 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050 2023-11-03 13:56:00,480 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797 2023-11-03 13:56:00,487 DEBUG [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072 2023-11-03 13:56:00,487 INFO [StoreOpener-46cdc5862837157d20f70fafedc327bc-1] regionserver.HStore(310): Store=46cdc5862837157d20f70fafedc327bc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:00,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:00,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:00,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 46cdc5862837157d20f70fafedc327bc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71995512, jitterRate=0.07281672954559326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:00,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:56:00,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., pid=101, masterSystemTime=1699019760385 2023-11-03 13:56:00,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:00,497 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-03 13:56:00,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-03 13:56:00,497 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-03 13:56:00,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:00,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:00,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1895869427f29144d076bec60ad1ba7, NAME => 'testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-03 13:56:00,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=46cdc5862837157d20f70fafedc327bc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019760499"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019760499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019760499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019760499"}]},"ts":"1699019760499"} 2023-11-03 13:56:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,501 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-03 13:56:00,501 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,501 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1912): 46cdc5862837157d20f70fafedc327bc/family1 is initiating minor compaction (all files) 2023-11-03 13:56:00,501 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-03 13:56:00,501 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 46cdc5862837157d20f70fafedc327bc/family1 in testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:00,501 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1912): 46cdc5862837157d20f70fafedc327bc/family2 is initiating minor compaction (all files) 2023-11-03 13:56:00,501 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp, totalSize=21.6 K 2023-11-03 13:56:00,501 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 46cdc5862837157d20f70fafedc327bc/family2 in testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:00,501 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp, totalSize=20.4 K 2023-11-03 13:56:00,502 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:56:00,502 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739993 2023-11-03 13:56:00,502 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:56:00,502 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739993 2023-11-03 13:56:00,502 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1895869427f29144d076bec60ad1ba7 columnFamilyName family1 2023-11-03 13:56:00,502 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741874 2023-11-03 13:56:00,504 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741874 2023-11-03 13:56:00,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-03 13:56:00,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 46cdc5862837157d20f70fafedc327bc, server=jenkins-hbase20.apache.org,46707,1699019650288 in 293 msec 2023-11-03 13:56:00,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46cdc5862837157d20f70fafedc327bc, ASSIGN in 465 msec 2023-11-03 13:56:00,515 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743176 2023-11-03 13:56:00,515 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743176 2023-11-03 13:56:00,515 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744740 2023-11-03 13:56:00,516 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744740 2023-11-03 13:56:00,587 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c 2023-11-03 13:56:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-03 13:56:00,659 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 46cdc5862837157d20f70fafedc327bc#family1#compaction#113 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:00,659 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc 2023-11-03 13:56:00,698 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): 46cdc5862837157d20f70fafedc327bc#family2#compaction#114 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:00,726 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f 2023-11-03 13:56:00,778 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c 2023-11-03 13:56:00,778 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(310): Store=c1895869427f29144d076bec60ad1ba7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:00,779 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,780 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2 2023-11-03 13:56:00,780 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2 2023-11-03 13:56:00,780 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1895869427f29144d076bec60ad1ba7 columnFamilyName family2 2023-11-03 13:56:00,800 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family2/b8f73c960b9c498689626b32bb257d93 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/b8f73c960b9c498689626b32bb257d93 2023-11-03 13:56:00,805 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-03 13:56:00,806 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 46cdc5862837157d20f70fafedc327bc/family2 of 46cdc5862837157d20f70fafedc327bc into b8f73c960b9c498689626b32bb257d93(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:00,806 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:56:00,806 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., storeName=46cdc5862837157d20f70fafedc327bc/family2, priority=12, startTime=1699019760497; duration=0sec 2023-11-03 13:56:00,806 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:00,808 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1 2023-11-03 13:56:00,814 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60 2023-11-03 13:56:00,825 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a 2023-11-03 13:56:00,853 DEBUG [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd 2023-11-03 13:56:00,854 INFO [StoreOpener-c1895869427f29144d076bec60ad1ba7-1] regionserver.HStore(310): Store=c1895869427f29144d076bec60ad1ba7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:00,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:00,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:00,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c1895869427f29144d076bec60ad1ba7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71731156, jitterRate=0.06887751817703247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:00,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:56:00,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., pid=103, masterSystemTime=1699019760385 2023-11-03 13:56:00,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-03 13:56:00,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-03 13:56:00,885 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-03 13:56:00,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:00,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:00,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:00,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c349b5a83940e7ac1020a6ff54953bba, NAME => 'testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.', STARTKEY => '2', ENDKEY => ''} 2023-11-03 13:56:00,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:00,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:00,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:00,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:00,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c1895869427f29144d076bec60ad1ba7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:00,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050] to archive 2023-11-03 13:56:00,889 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019760889"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019760889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019760889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019760889"}]},"ts":"1699019760889"} 2023-11-03 13:56:00,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:00,896 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-03 13:56:00,896 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1912): c1895869427f29144d076bec60ad1ba7/family1 is initiating minor compaction (all files) 2023-11-03 13:56:00,897 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c1895869427f29144d076bec60ad1ba7/family1 in testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:00,897 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp, totalSize=21.6 K 2023-11-03 13:56:00,898 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:00,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-03 13:56:00,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure c1895869427f29144d076bec60ad1ba7, server=jenkins-hbase20.apache.org,46707,1699019650288 in 673 msec 2023-11-03 13:56:00,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-469fb41cfc054cf3a4dcab4b2bc4766d 2023-11-03 13:56:00,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c1895869427f29144d076bec60ad1ba7, ASSIGN in 854 msec 2023-11-03 13:56:00,915 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739994 2023-11-03 13:56:00,915 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:56:00,915 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:56:00,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-969238407e7349cb98a7229815109072 2023-11-03 13:56:00,916 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c349b5a83940e7ac1020a6ff54953bba columnFamilyName family1 2023-11-03 13:56:00,917 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:56:00,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-5c0c38a065f24dbeab06110b033c2797 2023-11-03 13:56:00,920 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:56:00,922 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:56:00,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family2/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-56a0dd7ebccc4f44988b475404667050 2023-11-03 13:56:00,933 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0 2023-11-03 13:56:00,947 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a 2023-11-03 13:56:00,959 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd 2023-11-03 13:56:00,966 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e 2023-11-03 13:56:00,966 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(310): Store=c349b5a83940e7ac1020a6ff54953bba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:00,967 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:00,967 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2 2023-11-03 13:56:00,967 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2 2023-11-03 13:56:00,968 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c349b5a83940e7ac1020a6ff54953bba columnFamilyName family2 2023-11-03 13:56:00,977 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): c1895869427f29144d076bec60ad1ba7#family1#compaction#115 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:00,989 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c 2023-11-03 13:56:01,001 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c 2023-11-03 13:56:01,019 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b 2023-11-03 13:56:01,060 DEBUG [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(539): loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7 2023-11-03 13:56:01,060 INFO [StoreOpener-c349b5a83940e7ac1020a6ff54953bba-1] regionserver.HStore(310): Store=c349b5a83940e7ac1020a6ff54953bba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:01,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:01,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:01,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:01,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c349b5a83940e7ac1020a6ff54953bba; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73659098, jitterRate=0.09760609269142151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:01,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:56:01,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., pid=102, masterSystemTime=1699019760385 2023-11-03 13:56:01,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-03 13:56:01,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-03 13:56:01,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:01,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:01,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c349b5a83940e7ac1020a6ff54953bba, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:01,091 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699019761090"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019761090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019761090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019761090"}]},"ts":"1699019761090"} 2023-11-03 13:56:01,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-03 13:56:01,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure c349b5a83940e7ac1020a6ff54953bba, server=jenkins-hbase20.apache.org,46707,1699019650288 in 874 msec 2023-11-03 13:56:01,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=97 2023-11-03 13:56:01,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c349b5a83940e7ac1020a6ff54953bba, ASSIGN in 1.0540 sec 2023-11-03 13:56:01,108 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019761108"}]},"ts":"1699019761108"} 2023-11-03 13:56:01,110 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-03 13:56:01,115 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-03 13:56:01,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 1.0960 sec 2023-11-03 13:56:01,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-03 13:56:01,144 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-03 13:56:01,154 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:01,164 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:01,186 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:01,192 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:01,220 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:56:01,257 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-03 13:56:01,257 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,258 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(139): Connect 0x41f671c3 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:56:01,292 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f1fb521, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:56:01,292 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,292 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,292 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,476 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103cdbb9da6a7394ec6b3ffa8d3a474048b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231103cdbb9da6a7394ec6b3ffa8d3a474048b 2023-11-03 13:56:01,477 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,502 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:56:01,517 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:56:01,526 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:56:01,530 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:56:01,544 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/a267dd3dcd424b2893fa02d30bb52678 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-03 13:56:01,545 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=32 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/a267dd3dcd424b2893fa02d30bb52678}] 2023-11-03 13:56:01,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/a267dd3dcd424b2893fa02d30bb52678 for inclusion in 46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:56:01,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-03 13:56:01,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last=1 2023-11-03 13:56:01,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:56:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103/family1/a267dd3dcd424b2893fa02d30bb52678 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phg6gfi0k2bkeomaf8333jd0dnpr5aj7ukh33g1buak3a6a3hj2uhpka3tl4rgci/family1/a267dd3dcd424b2893fa02d30bb52678 2023-11-03 13:56:01,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phg6gfi0k2bkeomaf8333jd0dnpr5aj7ukh33g1buak3a6a3hj2uhpka3tl4rgci/family1/a267dd3dcd424b2893fa02d30bb52678 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/3b7a8ce7d06740388d6a4340f4940ed0_SeqId_35_ 2023-11-03 13:56:01,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phg6gfi0k2bkeomaf8333jd0dnpr5aj7ukh33g1buak3a6a3hj2uhpka3tl4rgci/family1/a267dd3dcd424b2893fa02d30bb52678 into 46cdc5862837157d20f70fafedc327bc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/3b7a8ce7d06740388d6a4340f4940ed0_SeqId_35_ - updating store file list. 2023-11-03 13:56:01,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/3b7a8ce7d06740388d6a4340f4940ed0_SeqId_35_ into 46cdc5862837157d20f70fafedc327bc/family1 2023-11-03 13:56:01,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phg6gfi0k2bkeomaf8333jd0dnpr5aj7ukh33g1buak3a6a3hj2uhpka3tl4rgci/family1/a267dd3dcd424b2893fa02d30bb52678 into 46cdc5862837157d20f70fafedc327bc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/3b7a8ce7d06740388d6a4340f4940ed0_SeqId_35_) 2023-11-03 13:56:01,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__phg6gfi0k2bkeomaf8333jd0dnpr5aj7ukh33g1buak3a6a3hj2uhpka3tl4rgci/family1/a267dd3dcd424b2893fa02d30bb52678 2023-11-03 13:56:01,564 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,564 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:01,566 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311030188413b827444228dd71e535ded3373 2023-11-03 13:56:01,566 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311034f3e134aa0ac4242a6366c8d337c2c70 2023-11-03 13:56:01,567 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311037432bbf6c3b54a1b9f0956ff6a97025b 2023-11-03 13:56:01,568 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231103b77f14c2e9494398892c90d68936c812 2023-11-03 13:56:01,569 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:56:01,569 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231103' 2023-11-03 13:56:01,569 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:56:01,858 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103107e6ad254944e38a5b8c6ff619ba332 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231103107e6ad254944e38a5b8c6ff619ba332 2023-11-03 13:56:01,859 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,876 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103dc88f9ccd1774130921323e7eab9bfba to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231103dc88f9ccd1774130921323e7eab9bfba 2023-11-03 13:56:01,877 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,893 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/5a070dd3e50f406e8318c4daf2fdc174 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-03 13:56:01,894 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/5a070dd3e50f406e8318c4daf2fdc174}] 2023-11-03 13:56:01,897 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/5a070dd3e50f406e8318c4daf2fdc174 for inclusion in c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:56:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-03 13:56:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-03 13:56:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:56:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103/family1/5a070dd3e50f406e8318c4daf2fdc174 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__4bk82t9rf96rtleuq6hv1m0k2vu0a588phphji2omk2m7gaqe9kmm9r59bl6hj2o/family1/5a070dd3e50f406e8318c4daf2fdc174 2023-11-03 13:56:01,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__4bk82t9rf96rtleuq6hv1m0k2vu0a588phphji2omk2m7gaqe9kmm9r59bl6hj2o/family1/5a070dd3e50f406e8318c4daf2fdc174 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_ 2023-11-03 13:56:01,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__4bk82t9rf96rtleuq6hv1m0k2vu0a588phphji2omk2m7gaqe9kmm9r59bl6hj2o/family1/5a070dd3e50f406e8318c4daf2fdc174 into c349b5a83940e7ac1020a6ff54953bba/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_ - updating store file list. 2023-11-03 13:56:01,923 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/a7856192a50c439c9c1381814208593f first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-03 13:56:01,924 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/a7856192a50c439c9c1381814208593f}] 2023-11-03 13:56:01,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/a7856192a50c439c9c1381814208593f for inclusion in c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:56:01,933 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_ into c349b5a83940e7ac1020a6ff54953bba/family1 2023-11-03 13:56:01,933 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__4bk82t9rf96rtleuq6hv1m0k2vu0a588phphji2omk2m7gaqe9kmm9r59bl6hj2o/family1/5a070dd3e50f406e8318c4daf2fdc174 into c349b5a83940e7ac1020a6ff54953bba/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_) 2023-11-03 13:56:01,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__4bk82t9rf96rtleuq6hv1m0k2vu0a588phphji2omk2m7gaqe9kmm9r59bl6hj2o/family1/5a070dd3e50f406e8318c4daf2fdc174 2023-11-03 13:56:01,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:01,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-03 13:56:01,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-03 13:56:01,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:56:01,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103/family1/a7856192a50c439c9c1381814208593f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__qion4fkgf1fuo7fiuuucqk42tn17fm7ce5dgbdus239i8b05vfvufglnoobufc8c/family1/a7856192a50c439c9c1381814208593f 2023-11-03 13:56:01,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-03 13:56:01,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(1912): c349b5a83940e7ac1020a6ff54953bba/family1 is initiating minor compaction (all files) 2023-11-03 13:56:01,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@426c0472; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-03 13:56:01,939 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,940 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__qion4fkgf1fuo7fiuuucqk42tn17fm7ce5dgbdus239i8b05vfvufglnoobufc8c/family1/a7856192a50c439c9c1381814208593f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/31e2d95ccdfa4d01bd24c3a0b8a01a55_SeqId_34_ 2023-11-03 13:56:01,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__qion4fkgf1fuo7fiuuucqk42tn17fm7ce5dgbdus239i8b05vfvufglnoobufc8c/family1/a7856192a50c439c9c1381814208593f into c1895869427f29144d076bec60ad1ba7/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/31e2d95ccdfa4d01bd24c3a0b8a01a55_SeqId_34_ - updating store file list. 2023-11-03 13:56:01,941 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103271fa8c2f1104835b201b691634fd671 2023-11-03 13:56:01,942 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023110381a3e176ccc74b99af47345a2c45f102 2023-11-03 13:56:01,947 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103e4160d00d8ef469090da11ba2d305239 2023-11-03 13:56:01,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/31e2d95ccdfa4d01bd24c3a0b8a01a55_SeqId_34_ into c1895869427f29144d076bec60ad1ba7/family1 2023-11-03 13:56:01,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__qion4fkgf1fuo7fiuuucqk42tn17fm7ce5dgbdus239i8b05vfvufglnoobufc8c/family1/a7856192a50c439c9c1381814208593f into c1895869427f29144d076bec60ad1ba7/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/31e2d95ccdfa4d01bd24c3a0b8a01a55_SeqId_34_) 2023-11-03 13:56:01,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testCompactionWithHFileLink__qion4fkgf1fuo7fiuuucqk42tn17fm7ce5dgbdus239i8b05vfvufglnoobufc8c/family1/a7856192a50c439c9c1381814208593f 2023-11-03 13:56:01,952 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/.tmp/family1/e82f9c6c8ed84f96bb55b7fa61dcf0c0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/e82f9c6c8ed84f96bb55b7fa61dcf0c0 2023-11-03 13:56:01,953 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231103eaf7bebdb517412c9edd844425faafb3 2023-11-03 13:56:01,953 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:56:01,953 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231103' 2023-11-03 13:56:01,954 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,954 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,961 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:01,962 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110345e69519756546908f80c0e1fafa81b8 2023-11-03 13:56:01,964 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 46cdc5862837157d20f70fafedc327bc/family1 of 46cdc5862837157d20f70fafedc327bc into e82f9c6c8ed84f96bb55b7fa61dcf0c0(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:01,964 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110346e2bf4623e84154be71e05b8a1456d0 2023-11-03 13:56:01,964 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:56:01,964 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc., storeName=46cdc5862837157d20f70fafedc327bc/family1, priority=12, startTime=1699019760496; duration=1sec 2023-11-03 13:56:01,964 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-03 13:56:01,964 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c349b5a83940e7ac1020a6ff54953bba/family1 in testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:01,964 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp, totalSize=28.9 K 2023-11-03 13:56:01,965 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739995 2023-11-03 13:56:01,966 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110381b0e31fa8a64ea08c3e0f9d53088dad 2023-11-03 13:56:01,966 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:56:01,966 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:56:01,967 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:56:01,967 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699019739995 2023-11-03 13:56:01,967 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231103ae0ee0d50da94042973ed32ac52fa551 2023-11-03 13:56:01,967 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-03 13:56:01,968 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231103' 2023-11-03 13:56:01,969 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231103 for table='testCompactionWithHFileLink' and column='family1' 2023-11-03 13:56:01,969 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-03 13:56:01,975 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:01,978 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:01,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd] to archive 2023-11-03 13:56:01,984 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:01,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:01,985 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:01,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-6f25fa054ca34fb59c2240fb9b1370b9 2023-11-03 13:56:01,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-261e6ad667ce40afa2f2ae6a3bec3a38 2023-11-03 13:56:01,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-681f70e7ea2e41928ad2ed6d3be81317 2023-11-03 13:56:01,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/family1/testCompactionWithHFileLink=46cdc5862837157d20f70fafedc327bc-1977071189624a56b59eaad44a5f18fd 2023-11-03 13:56:01,995 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): c349b5a83940e7ac1020a6ff54953bba#family1#compaction#116 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:01,997 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:01,998 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:02,033 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=291 (was 245) - Thread LEAK? -, OpenFileDescriptor=779 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1001 (was 1102), ProcessCount=198 (was 191) - ProcessCount LEAK? -, AvailableMemoryMB=227 (was 631) 2023-11-03 13:56:02,052 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=288, OpenFileDescriptor=779, MaxFileDescriptor=60000, SystemLoadAverage=1001, ProcessCount=198, AvailableMemoryMB=226 2023-11-03 13:56:02,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-11-03 13:56:02,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-03 13:56:02,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-03 13:56:02,082 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-03 13:56:02,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 24 msec 2023-11-03 13:56:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-03 13:56:02,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-03 13:56:02,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-03 13:56:02,177 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:56:02,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-03 13:56:02,179 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:56:02,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:02,191 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:02,192 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:02,193 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2 empty. 2023-11-03 13:56:02,195 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:02,195 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d empty. 2023-11-03 13:56:02,196 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:02,196 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1 empty. 2023-11-03 13:56:02,198 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:02,199 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:02,199 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-03 13:56:02,223 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family1/8a931281b7d949b5a5ada472ae6a77aa as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/8a931281b7d949b5a5ada472ae6a77aa 2023-11-03 13:56:02,228 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c1895869427f29144d076bec60ad1ba7/family1 of c1895869427f29144d076bec60ad1ba7 into 8a931281b7d949b5a5ada472ae6a77aa(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:02,228 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:56:02,228 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., storeName=c1895869427f29144d076bec60ad1ba7/family1, priority=12, startTime=1699019760883; duration=1sec 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. because compaction request was cancelled 2023-11-03 13:56:02,229 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-03 13:56:02,231 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-03 13:56:02,232 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1912): c349b5a83940e7ac1020a6ff54953bba/family2 is initiating minor compaction (all files) 2023-11-03 13:56:02,232 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c349b5a83940e7ac1020a6ff54953bba/family2 in testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:02,232 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp, totalSize=20.4 K 2023-11-03 13:56:02,233 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739995 2023-11-03 13:56:02,234 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:56:02,234 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:56:02,235 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:56:02,254 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] throttle.PressureAwareThroughputController(145): c349b5a83940e7ac1020a6ff54953bba#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:02,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:02,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f] to archive 2023-11-03 13:56:02,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:02,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-d702b2dae9494e308f56c080fc8a715c 2023-11-03 13:56:02,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-3fa62a6697f944168b9cb04ef69e95fc 2023-11-03 13:56:02,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-001e8324df294cb18f9eed33aa58137c 2023-11-03 13:56:02,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family1/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-98fc2bea3ff244bd93ff27eac66dbc2f 2023-11-03 13:56:02,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:02,622 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-03 13:56:02,623 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7b948d6a87719f2b1cc30a04e963f90d, NAME => 'ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:02,623 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => cb8d8f1509b262c97e50f80367a86aa1, NAME => 'ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:02,624 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => c1dc363b0a4a8bd24f43f4db8cf648a2, NAME => 'ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing c1dc363b0a4a8bd24f43f4db8cf648a2, disabling compactions & flushes 2023-11-03 13:56:02,655 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. after waiting 0 ms 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:02,655 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:02,655 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:02,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:02,826 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family1/99343ac10ddf4ae4a64ccb1afbcb6203 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/99343ac10ddf4ae4a64ccb1afbcb6203 2023-11-03 13:56:02,830 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c349b5a83940e7ac1020a6ff54953bba/family1 of c349b5a83940e7ac1020a6ff54953bba into 99343ac10ddf4ae4a64ccb1afbcb6203(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:02,830 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:56:02,830 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699019761937; duration=0sec 2023-11-03 13:56:02,831 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-03 13:56:02,831 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-03 13:56:02,832 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-03 13:56:02,832 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1912): c1895869427f29144d076bec60ad1ba7/family2 is initiating minor compaction (all files) 2023-11-03 13:56:02,833 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c1895869427f29144d076bec60ad1ba7/family2 in testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:02,833 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp, totalSize=20.4 K 2023-11-03 13:56:02,833 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019739994 2023-11-03 13:56:02,833 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019741875 2023-11-03 13:56:02,834 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019743177 2023-11-03 13:56:02,834 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019744741 2023-11-03 13:56:02,847 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): c1895869427f29144d076bec60ad1ba7#family2#compaction#118 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-03 13:56:02,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_] to archive 2023-11-03 13:56:02,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:02,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-a08b2d1b997e499a9307c709dc2ab73a 2023-11-03 13:56:02,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-d604c7ad22fd491cbac6063b8a5930dd 2023-11-03 13:56:02,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-f5b3b4e0e8a04f429faa9bb05cfc906e 2023-11-03 13:56:02,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-7b5c4f94e7b042d0b0735d3bb37e40a0 2023-11-03 13:56:02,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family1/8f731dffdb72494ba64dbc9af752d9b3_SeqId_34_ 2023-11-03 13:56:03,045 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:03,046 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing cb8d8f1509b262c97e50f80367a86aa1, disabling compactions & flushes 2023-11-03 13:56:03,046 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,046 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,046 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. after waiting 0 ms 2023-11-03 13:56:03,046 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,046 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,046 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:03,052 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:03,052 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 7b948d6a87719f2b1cc30a04e963f90d, disabling compactions & flushes 2023-11-03 13:56:03,053 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,053 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,053 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. after waiting 0 ms 2023-11-03 13:56:03,053 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,053 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,053 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:03,056 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:56:03,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019763057"}]},"ts":"1699019763057"} 2023-11-03 13:56:03,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019763057"}]},"ts":"1699019763057"} 2023-11-03 13:56:03,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699019763057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019763057"}]},"ts":"1699019763057"} 2023-11-03 13:56:03,060 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-03 13:56:03,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:56:03,061 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019763061"}]},"ts":"1699019763061"} 2023-11-03 13:56:03,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-03 13:56:03,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c1dc363b0a4a8bd24f43f4db8cf648a2, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b948d6a87719f2b1cc30a04e963f90d, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb8d8f1509b262c97e50f80367a86aa1, ASSIGN}] 2023-11-03 13:56:03,067 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b948d6a87719f2b1cc30a04e963f90d, ASSIGN 2023-11-03 13:56:03,067 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c1dc363b0a4a8bd24f43f4db8cf648a2, ASSIGN 2023-11-03 13:56:03,067 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb8d8f1509b262c97e50f80367a86aa1, ASSIGN 2023-11-03 13:56:03,068 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb8d8f1509b262c97e50f80367a86aa1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:03,068 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c1dc363b0a4a8bd24f43f4db8cf648a2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:03,068 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b948d6a87719f2b1cc30a04e963f90d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:03,096 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/.tmp/family2/5224c5f1a9b34e6f9ab77c2c8c81880e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/5224c5f1a9b34e6f9ab77c2c8c81880e 2023-11-03 13:56:03,101 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c349b5a83940e7ac1020a6ff54953bba/family2 of c349b5a83940e7ac1020a6ff54953bba into 5224c5f1a9b34e6f9ab77c2c8c81880e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:03,101 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:56:03,101 INFO [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba., storeName=c349b5a83940e7ac1020a6ff54953bba/family2, priority=12, startTime=1699019761083; duration=0sec 2023-11-03 13:56:03,101 DEBUG [RS:0;jenkins-hbase20:46707-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:03,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c] to archive 2023-11-03 13:56:03,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:03,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-6f4ea4d72a184fe39e2b3f58ab3f7c9b 2023-11-03 13:56:03,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-e428e637e73e4792bc0492afc2e5a8c7 2023-11-03 13:56:03,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-1cb74d45609a48bcaeb95b51c1bd983c 2023-11-03 13:56:03,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/family2/testCompactionWithHFileLink=c349b5a83940e7ac1020a6ff54953bba-19f1bad16336444dbcdbe0dee632b60c 2023-11-03 13:56:03,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c1dc363b0a4a8bd24f43f4db8cf648a2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763221"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019763221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019763221"}]},"ts":"1699019763221"} 2023-11-03 13:56:03,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=cb8d8f1509b262c97e50f80367a86aa1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,222 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763222"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019763222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019763222"}]},"ts":"1699019763222"} 2023-11-03 13:56:03,223 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7b948d6a87719f2b1cc30a04e963f90d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,223 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699019763223"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019763223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019763223"}]},"ts":"1699019763223"} 2023-11-03 13:56:03,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c1dc363b0a4a8bd24f43f4db8cf648a2, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:03,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 7b948d6a87719f2b1cc30a04e963f90d, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:03,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure cb8d8f1509b262c97e50f80367a86aa1, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:03,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:03,390 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb8d8f1509b262c97e50f80367a86aa1, NAME => 'ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.', STARTKEY => '2', ENDKEY => ''} 2023-11-03 13:56:03,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,411 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,423 DEBUG [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1 2023-11-03 13:56:03,423 DEBUG [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1 2023-11-03 13:56:03,424 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb8d8f1509b262c97e50f80367a86aa1 columnFamilyName family1 2023-11-03 13:56:03,425 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] regionserver.HStore(310): Store=cb8d8f1509b262c97e50f80367a86aa1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,426 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,427 DEBUG [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2 2023-11-03 13:56:03,427 DEBUG [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2 2023-11-03 13:56:03,427 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb8d8f1509b262c97e50f80367a86aa1 columnFamilyName family2 2023-11-03 13:56:03,428 INFO [StoreOpener-cb8d8f1509b262c97e50f80367a86aa1-1] regionserver.HStore(310): Store=cb8d8f1509b262c97e50f80367a86aa1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:03,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:03,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:03,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cb8d8f1509b262c97e50f80367a86aa1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62715933, jitterRate=-0.06545977294445038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:03,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:03,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1., pid=111, masterSystemTime=1699019763390 2023-11-03 13:56:03,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:03,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:03,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1dc363b0a4a8bd24f43f4db8cf648a2, NAME => 'ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.', STARTKEY => '', ENDKEY => '1'} 2023-11-03 13:56:03,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=cb8d8f1509b262c97e50f80367a86aa1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763457"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019763457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019763457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019763457"}]},"ts":"1699019763457"} 2023-11-03 13:56:03,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:03,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,459 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-11-03 13:56:03,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure cb8d8f1509b262c97e50f80367a86aa1, server=jenkins-hbase20.apache.org,46707,1699019650288 in 230 msec 2023-11-03 13:56:03,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb8d8f1509b262c97e50f80367a86aa1, ASSIGN in 395 msec 2023-11-03 13:56:03,462 DEBUG [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1 2023-11-03 13:56:03,462 DEBUG [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1 2023-11-03 13:56:03,463 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1dc363b0a4a8bd24f43f4db8cf648a2 columnFamilyName family1 2023-11-03 13:56:03,463 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] regionserver.HStore(310): Store=c1dc363b0a4a8bd24f43f4db8cf648a2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,464 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,465 DEBUG [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2 2023-11-03 13:56:03,465 DEBUG [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2 2023-11-03 13:56:03,465 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1dc363b0a4a8bd24f43f4db8cf648a2 columnFamilyName family2 2023-11-03 13:56:03,468 INFO [StoreOpener-c1dc363b0a4a8bd24f43f4db8cf648a2-1] regionserver.HStore(310): Store=c1dc363b0a4a8bd24f43f4db8cf648a2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:03,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:03,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c1dc363b0a4a8bd24f43f4db8cf648a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72768345, jitterRate=0.08433283865451813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:03,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:03,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2., pid=109, masterSystemTime=1699019763390 2023-11-03 13:56:03,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:03,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:03,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,478 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c1dc363b0a4a8bd24f43f4db8cf648a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b948d6a87719f2b1cc30a04e963f90d, NAME => 'ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.', STARTKEY => '1', ENDKEY => '2'} 2023-11-03 13:56:03,478 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699019763478"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019763478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019763478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019763478"}]},"ts":"1699019763478"} 2023-11-03 13:56:03,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:03,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,479 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-11-03 13:56:03,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c1dc363b0a4a8bd24f43f4db8cf648a2, server=jenkins-hbase20.apache.org,46707,1699019650288 in 254 msec 2023-11-03 13:56:03,480 DEBUG [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1 2023-11-03 13:56:03,480 DEBUG [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1 2023-11-03 13:56:03,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c1dc363b0a4a8bd24f43f4db8cf648a2, ASSIGN in 415 msec 2023-11-03 13:56:03,481 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b948d6a87719f2b1cc30a04e963f90d columnFamilyName family1 2023-11-03 13:56:03,482 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] regionserver.HStore(310): Store=7b948d6a87719f2b1cc30a04e963f90d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,482 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,483 DEBUG [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2 2023-11-03 13:56:03,483 DEBUG [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2 2023-11-03 13:56:03,483 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b948d6a87719f2b1cc30a04e963f90d columnFamilyName family2 2023-11-03 13:56:03,484 INFO [StoreOpener-7b948d6a87719f2b1cc30a04e963f90d-1] regionserver.HStore(310): Store=7b948d6a87719f2b1cc30a04e963f90d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:03,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:03,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:03,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7b948d6a87719f2b1cc30a04e963f90d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75216346, jitterRate=0.12081089615821838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:03,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:03,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d., pid=110, masterSystemTime=1699019763390 2023-11-03 13:56:03,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:03,494 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7b948d6a87719f2b1cc30a04e963f90d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:03,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699019763494"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019763494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019763494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019763494"}]},"ts":"1699019763494"} 2023-11-03 13:56:03,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-11-03 13:56:03,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 7b948d6a87719f2b1cc30a04e963f90d, server=jenkins-hbase20.apache.org,46707,1699019650288 in 268 msec 2023-11-03 13:56:03,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-03 13:56:03,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b948d6a87719f2b1cc30a04e963f90d, ASSIGN in 432 msec 2023-11-03 13:56:03,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:56:03,499 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019763499"}]},"ts":"1699019763499"} 2023-11-03 13:56:03,500 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-03 13:56:03,502 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:56:03,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.3280 sec 2023-11-03 13:56:03,687 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/.tmp/family2/61e3578ac1bd423db0e975fbf2c01e53 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/61e3578ac1bd423db0e975fbf2c01e53 2023-11-03 13:56:03,696 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c1895869427f29144d076bec60ad1ba7/family2 of c1895869427f29144d076bec60ad1ba7 into 61e3578ac1bd423db0e975fbf2c01e53(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:03,696 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:56:03,696 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7., storeName=c1895869427f29144d076bec60ad1ba7/family2, priority=12, startTime=1699019760883; duration=0sec 2023-11-03 13:56:03,697 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:03,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a] to archive 2023-11-03 13:56:03,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:03,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-394adb639ec6484e9678e5c2173893d1 2023-11-03 13:56:03,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-53ac5f61bd52429690a87e9444a57c60 2023-11-03 13:56:03,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-c351df6ccb99466cb33224a79a41fbcd 2023-11-03 13:56:03,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/family2/testCompactionWithHFileLink=c1895869427f29144d076bec60ad1ba7-847ab53a7f5e4f5ab691268acd95564a 2023-11-03 13:56:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-03 13:56:04,287 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-03 13:56:04,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:04,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:04,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:04,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:04,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-03 13:56:04,302 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-03 13:56:04,302 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:04,302 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-03 13:56:04,302 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-03 13:56:04,303 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:04,303 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:04,304 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:04,304 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:04,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:04,304 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:04,304 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:04,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:04,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-03 13:56:04,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-03 13:56:04,305 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-03 13:56:04,305 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:04,306 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-03 13:56:04,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:04,306 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. started... 2023-11-03 13:56:04,308 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:04,308 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b948d6a87719f2b1cc30a04e963f90d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:04,308 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:04,308 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:04,308 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:04,308 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. started... 2023-11-03 13:56:04,308 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. started... 2023-11-03 13:56:04,308 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb8d8f1509b262c97e50f80367a86aa1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:04,308 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c1dc363b0a4a8bd24f43f4db8cf648a2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:04,728 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311034450485030fb46659f0a4dcfde737750 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311034450485030fb46659f0a4dcfde737750 2023-11-03 13:56:04,729 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103dea840f207fe490e8eb2690c04995ff0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231103dea840f207fe490e8eb2690c04995ff0 2023-11-03 13:56:04,731 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311034bb76b59257e4a66afc29bb86009a29c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311034bb76b59257e4a66afc29bb86009a29c 2023-11-03 13:56:04,746 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/3f8d949ff8014feabc59344da081d5da 2023-11-03 13:56:04,752 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/1e0e5d5d46e649ee80ef8017f68a9a92 2023-11-03 13:56:05,139 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/5944d75ab1894bb28d848a4b05e58084 2023-11-03 13:56:05,179 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311030c49019087a4473787be5ba32a3de8ab to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311030c49019087a4473787be5ba32a3de8ab 2023-11-03 13:56:05,191 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103afce8bc047a84ca892c1b26af4b21118 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231103afce8bc047a84ca892c1b26af4b21118 2023-11-03 13:56:05,572 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311030c5bc1e452c04235b393531534165701 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311030c5bc1e452c04235b393531534165701 2023-11-03 13:56:05,595 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/638dfe11a7bc4e9bbefd01358d37c686 2023-11-03 13:56:05,599 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/3f8d949ff8014feabc59344da081d5da as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da 2023-11-03 13:56:05,603 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:56:05,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/638dfe11a7bc4e9bbefd01358d37c686 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686 2023-11-03 13:56:05,608 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:05,609 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/acfa48723cb8499ca4712f411115cd14 2023-11-03 13:56:05,609 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c1dc363b0a4a8bd24f43f4db8cf648a2 in 1301ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:05,609 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-03 13:56:05,610 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:05,610 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:05,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:05,614 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/1e0e5d5d46e649ee80ef8017f68a9a92 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92 2023-11-03 13:56:05,618 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:56:05,619 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/acfa48723cb8499ca4712f411115cd14 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14 2023-11-03 13:56:05,623 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:05,623 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b948d6a87719f2b1cc30a04e963f90d in 1315ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:05,624 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:05,624 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:05,624 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:05,981 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/051e63b516c446509ad30097195d3116 2023-11-03 13:56:05,994 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/5944d75ab1894bb28d848a4b05e58084 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084 2023-11-03 13:56:06,000 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084, entries=4, sequenceid=5, filesize=5.4 K 2023-11-03 13:56:06,001 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/051e63b516c446509ad30097195d3116 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116 2023-11-03 13:56:06,006 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:06,008 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cb8d8f1509b262c97e50f80367a86aa1 in 1700ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:06,008 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:06,008 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:06,008 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:06,008 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:06,008 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,008 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-03 13:56:06,008 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-03 13:56:06,009 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:06,010 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:06,011 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,011 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:06,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-03 13:56:06,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a757e1b[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:06,014 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-03 13:56:06,014 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,019 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-03 13:56:06,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-03 13:56:06,019 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,019 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:06,019 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:06,021 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-03 13:56:06,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:06,021 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-03 13:56:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:06,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-03 13:56:06,028 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-03 13:56:06,028 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:06,028 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:06,028 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-03 13:56:06,028 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:06,030 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,030 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,030 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:06,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:06,031 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:06,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,036 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:06,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-03 13:56:06,040 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:06,040 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-03 13:56:06,040 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:06,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,040 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:06,041 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:06,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:06,141 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:06,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:06,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:06,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:06,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:06,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:06,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:06,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-03 13:56:06,156 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-03 13:56:06,157 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:06,157 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-03 13:56:06,157 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-03 13:56:06,161 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,161 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:06,162 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:06,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:06,162 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:06,163 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:06,163 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:06,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:06,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-03 13:56:06,164 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-03 13:56:06,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-03 13:56:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-03 13:56:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-03 13:56:06,164 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:06,164 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. started... 2023-11-03 13:56:06,164 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b948d6a87719f2b1cc30a04e963f90d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:06,166 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:06,166 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. started... 2023-11-03 13:56:06,166 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb8d8f1509b262c97e50f80367a86aa1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:06,170 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:06,170 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:06,173 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:06,173 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. started... 2023-11-03 13:56:06,174 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c1dc363b0a4a8bd24f43f4db8cf648a2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:06,235 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110354c467f2d1d4497ca0e5c445d402920f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110354c467f2d1d4497ca0e5c445d402920f 2023-11-03 13:56:06,615 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103e5dad780e012408cbf376a03b3f7fb3a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231103e5dad780e012408cbf376a03b3f7fb3a 2023-11-03 13:56:06,623 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311039a2527b79d084c00a91737c917c75d13 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311039a2527b79d084c00a91737c917c75d13 2023-11-03 13:56:06,663 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/982352c2493e44b0ada0430fdf2796d0 2023-11-03 13:56:06,682 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110385a28af5c569460cba682da589d70d5a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023110385a28af5c569460cba682da589d70d5a 2023-11-03 13:56:07,020 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/ac0e8665676d44f0b3c2f9af2debcc68 2023-11-03 13:56:07,035 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311031d0b1288b0b242b0811873905b69924f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311031d0b1288b0b242b0811873905b69924f 2023-11-03 13:56:07,035 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/cebeca0062ff44c1ae82b9d69cc774a1 2023-11-03 13:56:07,041 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/c2932d589fd1427f83d59f519ba6d131 2023-11-03 13:56:07,045 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/ac0e8665676d44f0b3c2f9af2debcc68 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68 2023-11-03 13:56:07,048 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:56:07,049 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/c2932d589fd1427f83d59f519ba6d131 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131 2023-11-03 13:56:07,053 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:07,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b948d6a87719f2b1cc30a04e963f90d in 889ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:07,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:07,054 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:07,054 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:07,097 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/3dc495f7f3fa47c59dbf9d804a43ebb7 2023-11-03 13:56:07,101 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/982352c2493e44b0ada0430fdf2796d0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0 2023-11-03 13:56:07,105 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:56:07,105 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/3dc495f7f3fa47c59dbf9d804a43ebb7 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7 2023-11-03 13:56:07,109 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:07,110 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cb8d8f1509b262c97e50f80367a86aa1 in 944ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:07,110 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:07,110 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:07,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:07,452 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311033d071b1fa8e5405f8055fb8e87e01425 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311033d071b1fa8e5405f8055fb8e87e01425 2023-11-03 13:56:07,458 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/925060e1995f4c5296404a40c8aa0453 2023-11-03 13:56:07,463 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/cebeca0062ff44c1ae82b9d69cc774a1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1 2023-11-03 13:56:07,468 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1, entries=4, sequenceid=9, filesize=5.4 K 2023-11-03 13:56:07,470 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/925060e1995f4c5296404a40c8aa0453 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453 2023-11-03 13:56:07,475 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:07,476 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c1dc363b0a4a8bd24f43f4db8cf648a2 in 1302ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:07,476 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:07,476 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:07,494 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:56:07,494 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76e0b88e to 127.0.0.1:53668 2023-11-03 13:56:07,494 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:07,495 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:07,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:07,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-03 13:56:07,496 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-03 13:56:07,498 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:56:07,498 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41f671c3 to 127.0.0.1:53668 2023-11-03 13:56:07,498 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:07,502 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,502 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:07,503 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,503 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:07,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-03 13:56:07,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d336ac1[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:07,509 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-03 13:56:07,509 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,513 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,514 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-03 13:56:07,514 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,514 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:07,514 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-03 13:56:07,514 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:07,515 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-03 13:56:07,515 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:07,515 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,515 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-03 13:56:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:07,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-03 13:56:07,519 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-03 13:56:07,519 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:07,519 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:07,519 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-03 13:56:07,519 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:07,530 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,530 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:07,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,530 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:07,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,535 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,536 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:07,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:07,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:07,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:07,546 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:07,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-03 13:56:07,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:07,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:07,547 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:07,547 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:07,647 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:07,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:07,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:07,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:07,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:07,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:07,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-03 13:56:07,666 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-03 13:56:07,666 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:07,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-03 13:56:07,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-03 13:56:07,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:07,670 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,670 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:07,670 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:07,670 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:07,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:07,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:07,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:07,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-03 13:56:07,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-03 13:56:07,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-03 13:56:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-03 13:56:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-03 13:56:07,681 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:07,681 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. started... 2023-11-03 13:56:07,681 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:07,681 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. started... 2023-11-03 13:56:07,681 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b948d6a87719f2b1cc30a04e963f90d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:07,681 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb8d8f1509b262c97e50f80367a86aa1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:07,682 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:07,682 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:07,682 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:07,682 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. started... 2023-11-03 13:56:07,682 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c1dc363b0a4a8bd24f43f4db8cf648a2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:07,755 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311032bc262eba31c47bd8c6fb5889119c205 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311032bc262eba31c47bd8c6fb5889119c205 2023-11-03 13:56:07,771 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/81d3ed7744b14363aaf83286b9305324 2023-11-03 13:56:07,823 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103ae79745f72754338a6822b7056f58e79 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231103ae79745f72754338a6822b7056f58e79 2023-11-03 13:56:08,155 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103a49ea68d22774597b620810d33487bc3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231103a49ea68d22774597b620810d33487bc3 2023-11-03 13:56:08,161 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311036dee06ae36f2467f85ad1f63d7f52888 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311036dee06ae36f2467f85ad1f63d7f52888 2023-11-03 13:56:08,164 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/3ab3a19ab0b04e6d839e8e05ab846bb5 2023-11-03 13:56:08,172 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/872e2d7fa7684bf889a7089000b73045 2023-11-03 13:56:08,202 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311035b5e5bb67e154090b4cb0436c224f212 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311035b5e5bb67e154090b4cb0436c224f212 2023-11-03 13:56:08,246 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/ef068307aa754ea5928479e3dd5017fd 2023-11-03 13:56:08,252 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/81d3ed7744b14363aaf83286b9305324 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324 2023-11-03 13:56:08,256 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:56:08,257 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/ef068307aa754ea5928479e3dd5017fd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd 2023-11-03 13:56:08,265 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:08,270 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b948d6a87719f2b1cc30a04e963f90d in 589ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:08,270 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:08,271 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:08,274 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:08,589 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103522bf1e85e7e46a3bd63108248ee7dec to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231103522bf1e85e7e46a3bd63108248ee7dec 2023-11-03 13:56:08,607 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/2d4a077289554fab8544ceba05d2ccb1 2023-11-03 13:56:08,611 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/872e2d7fa7684bf889a7089000b73045 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045 2023-11-03 13:56:08,615 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:56:08,616 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/2d4a077289554fab8544ceba05d2ccb1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1 2023-11-03 13:56:08,621 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:08,621 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c1dc363b0a4a8bd24f43f4db8cf648a2 in 939ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:08,622 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:08,622 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:08,622 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:08,902 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:56:08,994 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/4bb9581ab7a444b69d0ae949afee4748 2023-11-03 13:56:08,999 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/3ab3a19ab0b04e6d839e8e05ab846bb5 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5 2023-11-03 13:56:09,002 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-03 13:56:09,003 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/4bb9581ab7a444b69d0ae949afee4748 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748 2023-11-03 13:56:09,008 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:09,009 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cb8d8f1509b262c97e50f80367a86aa1 in 1328ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:09,009 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:09,009 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-03 13:56:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-03 13:56:09,014 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:09,018 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:09,027 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,027 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:09,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-03 13:56:09,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1365dd7c[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:09,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-03 13:56:09,037 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,038 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,038 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,038 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-03 13:56:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-03 13:56:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:09,046 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-03 13:56:09,047 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:09,047 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-03 13:56:09,047 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:09,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:09,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-03 13:56:09,056 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-03 13:56:09,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:09,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:09,056 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-03 13:56:09,056 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:09,058 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,058 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,058 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:09,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,058 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:09,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,059 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,061 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:09,061 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,061 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:09,061 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:09,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-03 13:56:09,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:09,061 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:09,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:09,062 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:09,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:09,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:09,162 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:09,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:09,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:09,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:09,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:09,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:09,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:09,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-03 13:56:09,171 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-03 13:56:09,171 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:09,171 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-03 13:56:09,171 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-03 13:56:09,175 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,175 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:09,179 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:09,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:09,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:09,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:09,181 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-03 13:56:09,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-03 13:56:09,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-03 13:56:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-03 13:56:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-03 13:56:09,182 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:09,182 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. started... 2023-11-03 13:56:09,182 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:09,182 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. started... 2023-11-03 13:56:09,182 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b948d6a87719f2b1cc30a04e963f90d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:09,182 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb8d8f1509b262c97e50f80367a86aa1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:09,183 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,190 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:09,190 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:09,192 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:09,192 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. started... 2023-11-03 13:56:09,192 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c1dc363b0a4a8bd24f43f4db8cf648a2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:09,194 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:09,194 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:09,284 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311034b16ea7063344b40b6151931fef1d92d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311034b16ea7063344b40b6151931fef1d92d 2023-11-03 13:56:09,285 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103c2d240c109e54700b424a33396a76a2b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231103c2d240c109e54700b424a33396a76a2b 2023-11-03 13:56:09,295 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311039a107bc389f94833b84a98af15e2e62d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311039a107bc389f94833b84a98af15e2e62d 2023-11-03 13:56:09,328 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/68a79dc4eb6d4f37bc20f93600d3628f 2023-11-03 13:56:09,354 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103bae8ac7fdbc748b9b75c97c12cb73e8f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231103bae8ac7fdbc748b9b75c97c12cb73e8f 2023-11-03 13:56:09,728 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/dbfc74fdc80b41d08f0f73541571f3c8 2023-11-03 13:56:09,737 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/b904b3dced0a47bcbbaa40a93b907cfa 2023-11-03 13:56:09,767 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/0199508172894c5ca42b71bf1d8406f3 2023-11-03 13:56:09,772 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/68a79dc4eb6d4f37bc20f93600d3628f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f 2023-11-03 13:56:09,778 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:56:09,779 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/0199508172894c5ca42b71bf1d8406f3 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3 2023-11-03 13:56:09,785 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:09,786 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c1dc363b0a4a8bd24f43f4db8cf648a2 in 594ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:09,786 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:09,786 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:10,147 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103029d706282fe405a98aeddff3ed4aa85 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231103029d706282fe405a98aeddff3ed4aa85 2023-11-03 13:56:10,161 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103b05d5dbd1f0045a681bf9ce4ae96c6f8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231103b05d5dbd1f0045a681bf9ce4ae96c6f8 2023-11-03 13:56:10,551 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/bf1d37991a3e430c9991599e4309e286 2023-11-03 13:56:10,557 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/dbfc74fdc80b41d08f0f73541571f3c8 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8 2023-11-03 13:56:10,561 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:56:10,562 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/bf1d37991a3e430c9991599e4309e286 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286 2023-11-03 13:56:10,566 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/345b47616a9047e8abbd72d100c86d3f 2023-11-03 13:56:10,568 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:10,575 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b948d6a87719f2b1cc30a04e963f90d in 1393ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:10,575 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:10,575 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:10,578 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:10,579 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/b904b3dced0a47bcbbaa40a93b907cfa as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa 2023-11-03 13:56:10,594 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa, entries=4, sequenceid=17, filesize=5.4 K 2023-11-03 13:56:10,599 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/345b47616a9047e8abbd72d100c86d3f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f 2023-11-03 13:56:10,620 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:10,623 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cb8d8f1509b262c97e50f80367a86aa1 in 1441ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:10,623 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:10,623 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:10,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:10,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:10,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-03 13:56:10,626 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-03 13:56:10,643 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,645 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,645 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:10,650 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:10,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:10,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:10,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:10,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:10,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-03 13:56:10,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f723c29[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:10,673 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-03 13:56:10,673 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,679 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,679 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-03 13:56:10,679 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-03 13:56:10,679 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:10,688 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-03 13:56:10,689 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:10,689 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-03 13:56:10,690 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-03 13:56:10,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:10,691 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-03 13:56:10,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:10,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:10,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-03 13:56:10,691 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:10,696 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,696 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:10,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,696 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:10,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:10,697 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:10,698 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,705 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,705 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:10,705 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:10,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:10,705 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:10,705 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:10,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-03 13:56:10,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:10,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:10,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:10,706 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:10,707 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,807 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:10,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:10,824 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:10,840 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:10,852 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:10,853 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:10,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:10,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:10,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-03 13:56:10,916 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-03 13:56:10,916 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:10,916 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-03 13:56:10,916 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-03 13:56:10,916 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,916 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:10,923 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:10,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:10,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:10,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:10,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:10,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:10,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:10,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-03 13:56:10,925 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,926 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:10,926 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:10,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-03 13:56:10,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-03 13:56:10,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-03 13:56:10,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:10,926 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-03 13:56:10,927 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:10,927 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. started... 2023-11-03 13:56:10,927 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b948d6a87719f2b1cc30a04e963f90d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:10,928 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:10,928 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:10,928 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:10,928 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:10,928 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. started... 2023-11-03 13:56:10,928 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. started... 2023-11-03 13:56:10,928 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb8d8f1509b262c97e50f80367a86aa1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:10,928 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c1dc363b0a4a8bd24f43f4db8cf648a2 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:10,985 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/ee11f6ec2db241c2888c470ac4ab35df 2023-11-03 13:56:10,990 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/1ead434ce3a9431d9b558b121971104e 2023-11-03 13:56:10,995 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee11f6ec2db241c2888c470ac4ab35df 2023-11-03 13:56:11,007 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/133b7c2c5e784e4f9f7cebd7816091e1 2023-11-03 13:56:11,008 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ead434ce3a9431d9b558b121971104e 2023-11-03 13:56:11,016 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 133b7c2c5e784e4f9f7cebd7816091e1 2023-11-03 13:56:11,057 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/e4f91fc4218c48dc89262a470122f27d 2023-11-03 13:56:11,062 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4f91fc4218c48dc89262a470122f27d 2023-11-03 13:56:11,062 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/1ead434ce3a9431d9b558b121971104e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e 2023-11-03 13:56:11,069 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/2dbcdb6b055348d4afaa44e3e16b7c84 2023-11-03 13:56:11,070 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ead434ce3a9431d9b558b121971104e 2023-11-03 13:56:11,071 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e, entries=3, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,072 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/e4f91fc4218c48dc89262a470122f27d as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d 2023-11-03 13:56:11,073 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbcdb6b055348d4afaa44e3e16b7c84 2023-11-03 13:56:11,074 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/133b7c2c5e784e4f9f7cebd7816091e1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1 2023-11-03 13:56:11,081 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4f91fc4218c48dc89262a470122f27d 2023-11-03 13:56:11,081 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,082 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b948d6a87719f2b1cc30a04e963f90d in 155ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:11,083 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:11,083 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:11,086 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 133b7c2c5e784e4f9f7cebd7816091e1 2023-11-03 13:56:11,086 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1, entries=3, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,087 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/2dbcdb6b055348d4afaa44e3e16b7c84 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84 2023-11-03 13:56:11,092 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbcdb6b055348d4afaa44e3e16b7c84 2023-11-03 13:56:11,092 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,093 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cb8d8f1509b262c97e50f80367a86aa1 in 165ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:11,093 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:11,093 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:11,841 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/f01bd4d5c7a8407e9bb5f8edba0c9045 2023-11-03 13:56:11,846 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f01bd4d5c7a8407e9bb5f8edba0c9045 2023-11-03 13:56:11,846 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/ee11f6ec2db241c2888c470ac4ab35df as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df 2023-11-03 13:56:11,865 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee11f6ec2db241c2888c470ac4ab35df 2023-11-03 13:56:11,865 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df, entries=3, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,866 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/f01bd4d5c7a8407e9bb5f8edba0c9045 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045 2023-11-03 13:56:11,872 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f01bd4d5c7a8407e9bb5f8edba0c9045 2023-11-03 13:56:11,872 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:11,873 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c1dc363b0a4a8bd24f43f4db8cf648a2 in 945ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:11,873 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:11,873 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:11,874 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:11,874 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:11,874 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,874 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-03 13:56:11,874 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-03 13:56:11,875 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,875 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,875 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:11,882 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:11,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-03 13:56:11,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e56167a[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:11,884 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-03 13:56:11,884 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,890 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,890 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,890 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,891 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-03 13:56:11,891 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-03 13:56:11,891 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:11,892 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,892 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-03 13:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:11,892 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:11,892 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-03 13:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:11,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-03 13:56:11,895 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-03 13:56:11,896 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:11,896 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:11,896 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-03 13:56:11,896 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:11,897 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,897 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,897 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:11,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:11,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:11,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:11,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:11,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:11,898 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,899 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:11,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-03 13:56:11,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,901 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,901 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:11,901 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:11,901 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:11,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:11,902 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-03 13:56:11,902 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-03 13:56:11,902 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-03 13:56:11,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:11,902 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:12,002 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:12,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:12,004 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:12,004 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 7b948d6a87719f2b1cc30a04e963f90d/family1 is initiating major compaction (all files) 2023-11-03 13:56:12,004 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:12,004 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:12,004 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 7b948d6a87719f2b1cc30a04e963f90d/family1 in ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:12,004 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp, totalSize=26.6 K 2023-11-03 13:56:12,005 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 1e0e5d5d46e649ee80ef8017f68a9a92, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764294 2023-11-03 13:56:12,006 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting ac0e8665676d44f0b3c2f9af2debcc68, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766144 2023-11-03 13:56:12,006 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 81d3ed7744b14363aaf83286b9305324, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:12,006 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting dbfc74fdc80b41d08f0f73541571f3c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:12,007 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 1ead434ce3a9431d9b558b121971104e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:12,035 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 7b948d6a87719f2b1cc30a04e963f90d#family1#compaction#149 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:12,071 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103e88f39dc5cb742b982dac8810f97e771_del 2023-11-03 13:56:12,071 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103e88f39dc5cb742b982dac8810f97e771_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231103e88f39dc5cb742b982dac8810f97e771_del 2023-11-03 13:56:12,904 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d631e057f2244b6f8a6257c93bd22ed7 2023-11-03 13:56:12,905 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family1/d631e057f2244b6f8a6257c93bd22ed7 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/d631e057f2244b6f8a6257c93bd22ed7 2023-11-03 13:56:12,913 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d631e057f2244b6f8a6257c93bd22ed7 2023-11-03 13:56:12,914 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b948d6a87719f2b1cc30a04e963f90d/family1 of 7b948d6a87719f2b1cc30a04e963f90d into d631e057f2244b6f8a6257c93bd22ed7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:12,914 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:12,914 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:12,914 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 7b948d6a87719f2b1cc30a04e963f90d/family2 is initiating major compaction (all files) 2023-11-03 13:56:12,915 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:12,915 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:12,916 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 7b948d6a87719f2b1cc30a04e963f90d/family2 in ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:12,916 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp, totalSize=25.3 K 2023-11-03 13:56:12,917 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting acfa48723cb8499ca4712f411115cd14, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764294 2023-11-03 13:56:12,917 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting c2932d589fd1427f83d59f519ba6d131, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766144 2023-11-03 13:56:12,918 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting ef068307aa754ea5928479e3dd5017fd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:12,918 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting bf1d37991a3e430c9991599e4309e286, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:12,918 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting e4f91fc4218c48dc89262a470122f27d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:12,930 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 7b948d6a87719f2b1cc30a04e963f90d#family2#compaction#150 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:12,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e] to archive 2023-11-03 13:56:12,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:12,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1e0e5d5d46e649ee80ef8017f68a9a92 2023-11-03 13:56:12,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/ac0e8665676d44f0b3c2f9af2debcc68 2023-11-03 13:56:12,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/81d3ed7744b14363aaf83286b9305324 2023-11-03 13:56:12,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/dbfc74fdc80b41d08f0f73541571f3c8 2023-11-03 13:56:12,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/1ead434ce3a9431d9b558b121971104e 2023-11-03 13:56:13,347 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311039dca01f9a53b49d7a424235e6bd6d0e0_del 2023-11-03 13:56:13,347 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311039dca01f9a53b49d7a424235e6bd6d0e0_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311039dca01f9a53b49d7a424235e6bd6d0e0_del 2023-11-03 13:56:13,917 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-03 13:56:14,167 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a91e90a19c14561a7783b0264a21e8d 2023-11-03 13:56:14,168 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/.tmp/family2/4a91e90a19c14561a7783b0264a21e8d as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/4a91e90a19c14561a7783b0264a21e8d 2023-11-03 13:56:14,172 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a91e90a19c14561a7783b0264a21e8d 2023-11-03 13:56:14,173 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b948d6a87719f2b1cc30a04e963f90d/family2 of 7b948d6a87719f2b1cc30a04e963f90d into 4a91e90a19c14561a7783b0264a21e8d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:14,173 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:14,173 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:14,173 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): cb8d8f1509b262c97e50f80367a86aa1/family1 is initiating major compaction (all files) 2023-11-03 13:56:14,173 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:14,173 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:14,174 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of cb8d8f1509b262c97e50f80367a86aa1/family1 in ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:14,174 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp, totalSize=26.6 K 2023-11-03 13:56:14,174 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 5944d75ab1894bb28d848a4b05e58084, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764294 2023-11-03 13:56:14,175 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 982352c2493e44b0ada0430fdf2796d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766144 2023-11-03 13:56:14,175 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3ab3a19ab0b04e6d839e8e05ab846bb5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:14,175 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting b904b3dced0a47bcbbaa40a93b907cfa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:14,176 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 133b7c2c5e784e4f9f7cebd7816091e1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:14,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d] to archive 2023-11-03 13:56:14,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:14,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/acfa48723cb8499ca4712f411115cd14 2023-11-03 13:56:14,185 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): cb8d8f1509b262c97e50f80367a86aa1#family1#compaction#151 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:14,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/c2932d589fd1427f83d59f519ba6d131 2023-11-03 13:56:14,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/ef068307aa754ea5928479e3dd5017fd 2023-11-03 13:56:14,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/bf1d37991a3e430c9991599e4309e286 2023-11-03 13:56:14,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family2/e4f91fc4218c48dc89262a470122f27d 2023-11-03 13:56:14,596 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103e7cd47c38d8f4020881bb613db5946c7_del 2023-11-03 13:56:14,596 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103e7cd47c38d8f4020881bb613db5946c7_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231103e7cd47c38d8f4020881bb613db5946c7_del 2023-11-03 13:56:15,434 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b2cd4d9089645c1ba0b8fcc8d4338bc 2023-11-03 13:56:15,435 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family1/4b2cd4d9089645c1ba0b8fcc8d4338bc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/4b2cd4d9089645c1ba0b8fcc8d4338bc 2023-11-03 13:56:15,439 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b2cd4d9089645c1ba0b8fcc8d4338bc 2023-11-03 13:56:15,440 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb8d8f1509b262c97e50f80367a86aa1/family1 of cb8d8f1509b262c97e50f80367a86aa1 into 4b2cd4d9089645c1ba0b8fcc8d4338bc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:15,440 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:15,440 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:15,440 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): cb8d8f1509b262c97e50f80367a86aa1/family2 is initiating major compaction (all files) 2023-11-03 13:56:15,441 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:15,441 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:15,441 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of cb8d8f1509b262c97e50f80367a86aa1/family2 in ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:15,441 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp, totalSize=25.3 K 2023-11-03 13:56:15,442 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 051e63b516c446509ad30097195d3116, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764294 2023-11-03 13:56:15,442 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3dc495f7f3fa47c59dbf9d804a43ebb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766144 2023-11-03 13:56:15,442 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 4bb9581ab7a444b69d0ae949afee4748, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:15,443 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 345b47616a9047e8abbd72d100c86d3f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:15,443 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 2dbcdb6b055348d4afaa44e3e16b7c84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:15,452 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): cb8d8f1509b262c97e50f80367a86aa1#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:15,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1] to archive 2023-11-03 13:56:15,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:15,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/5944d75ab1894bb28d848a4b05e58084 2023-11-03 13:56:15,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/982352c2493e44b0ada0430fdf2796d0 2023-11-03 13:56:15,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/3ab3a19ab0b04e6d839e8e05ab846bb5 2023-11-03 13:56:15,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/b904b3dced0a47bcbbaa40a93b907cfa 2023-11-03 13:56:15,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/133b7c2c5e784e4f9f7cebd7816091e1 2023-11-03 13:56:15,863 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311038bcfe912c35f4ee5a2a599a45585d57f_del 2023-11-03 13:56:15,863 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311038bcfe912c35f4ee5a2a599a45585d57f_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311038bcfe912c35f4ee5a2a599a45585d57f_del 2023-11-03 13:56:16,681 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b3f5e31530d4947a15637590ea963db 2023-11-03 13:56:16,682 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/.tmp/family2/7b3f5e31530d4947a15637590ea963db as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/7b3f5e31530d4947a15637590ea963db 2023-11-03 13:56:16,687 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b3f5e31530d4947a15637590ea963db 2023-11-03 13:56:16,688 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb8d8f1509b262c97e50f80367a86aa1/family2 of cb8d8f1509b262c97e50f80367a86aa1 into 7b3f5e31530d4947a15637590ea963db(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:16,688 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:16,688 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:16,688 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c1dc363b0a4a8bd24f43f4db8cf648a2/family1 is initiating major compaction (all files) 2023-11-03 13:56:16,689 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:16,689 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:16,690 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c1dc363b0a4a8bd24f43f4db8cf648a2/family1 in ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:16,690 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp, totalSize=26.6 K 2023-11-03 13:56:16,691 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3f8d949ff8014feabc59344da081d5da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764293 2023-11-03 13:56:16,691 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting cebeca0062ff44c1ae82b9d69cc774a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766143 2023-11-03 13:56:16,692 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 872e2d7fa7684bf889a7089000b73045, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:16,692 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 68a79dc4eb6d4f37bc20f93600d3628f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:16,692 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting ee11f6ec2db241c2888c470ac4ab35df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:16,703 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c1dc363b0a4a8bd24f43f4db8cf648a2#family1#compaction#153 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:16,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84] to archive 2023-11-03 13:56:16,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:16,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/051e63b516c446509ad30097195d3116 2023-11-03 13:56:16,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/3dc495f7f3fa47c59dbf9d804a43ebb7 2023-11-03 13:56:16,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/4bb9581ab7a444b69d0ae949afee4748 2023-11-03 13:56:16,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/345b47616a9047e8abbd72d100c86d3f 2023-11-03 13:56:16,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family2/2dbcdb6b055348d4afaa44e3e16b7c84 2023-11-03 13:56:17,115 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103d68df5e829e14785a0024e304f9f879b_del 2023-11-03 13:56:17,115 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103d68df5e829e14785a0024e304f9f879b_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231103d68df5e829e14785a0024e304f9f879b_del 2023-11-03 13:56:17,932 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aff8e4d149e04f78a58f25b72bf14960 2023-11-03 13:56:17,932 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family1/aff8e4d149e04f78a58f25b72bf14960 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/aff8e4d149e04f78a58f25b72bf14960 2023-11-03 13:56:17,936 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aff8e4d149e04f78a58f25b72bf14960 2023-11-03 13:56:17,937 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c1dc363b0a4a8bd24f43f4db8cf648a2/family1 of c1dc363b0a4a8bd24f43f4db8cf648a2 into aff8e4d149e04f78a58f25b72bf14960(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:17,938 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:17,938 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:17,938 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): c1dc363b0a4a8bd24f43f4db8cf648a2/family2 is initiating major compaction (all files) 2023-11-03 13:56:17,938 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:17,938 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:17,938 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of c1dc363b0a4a8bd24f43f4db8cf648a2/family2 in ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:17,938 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp, totalSize=25.3 K 2023-11-03 13:56:17,939 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 638dfe11a7bc4e9bbefd01358d37c686, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019764293 2023-11-03 13:56:17,939 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 925060e1995f4c5296404a40c8aa0453, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019766143 2023-11-03 13:56:17,940 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 2d4a077289554fab8544ceba05d2ccb1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019767649 2023-11-03 13:56:17,940 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 0199508172894c5ca42b71bf1d8406f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019769165 2023-11-03 13:56:17,941 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting f01bd4d5c7a8407e9bb5f8edba0c9045, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:17,950 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): c1dc363b0a4a8bd24f43f4db8cf648a2#family2#compaction#154 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:17,966 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110388f54a7ad4b0417890462d88c9d6379e_del 2023-11-03 13:56:17,967 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110388f54a7ad4b0417890462d88c9d6379e_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023110388f54a7ad4b0417890462d88c9d6379e_del 2023-11-03 13:56:17,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df] to archive 2023-11-03 13:56:17,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:17,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/3f8d949ff8014feabc59344da081d5da 2023-11-03 13:56:17,991 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87586d9cdce845a7b140836d9c474889 2023-11-03 13:56:17,992 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/.tmp/family2/87586d9cdce845a7b140836d9c474889 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/87586d9cdce845a7b140836d9c474889 2023-11-03 13:56:17,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/cebeca0062ff44c1ae82b9d69cc774a1 2023-11-03 13:56:17,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/872e2d7fa7684bf889a7089000b73045 2023-11-03 13:56:17,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/68a79dc4eb6d4f37bc20f93600d3628f 2023-11-03 13:56:17,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/ee11f6ec2db241c2888c470ac4ab35df 2023-11-03 13:56:17,999 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87586d9cdce845a7b140836d9c474889 2023-11-03 13:56:18,000 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c1dc363b0a4a8bd24f43f4db8cf648a2/family2 of c1dc363b0a4a8bd24f43f4db8cf648a2 into 87586d9cdce845a7b140836d9c474889(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:18,000 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:18,004 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:18,007 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:18,013 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:18,015 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:18,021 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:56:18,071 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-03 13:56:18,083 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103d68df5e829e14785a0024e304f9f879b_del 2023-11-03 13:56:18,089 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103e88f39dc5cb742b982dac8810f97e771_del 2023-11-03 13:56:18,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045] to archive 2023-11-03 13:56:18,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:18,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/638dfe11a7bc4e9bbefd01358d37c686 2023-11-03 13:56:18,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/925060e1995f4c5296404a40c8aa0453 2023-11-03 13:56:18,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/2d4a077289554fab8544ceba05d2ccb1 2023-11-03 13:56:18,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/0199508172894c5ca42b71bf1d8406f3 2023-11-03 13:56:18,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family2/f01bd4d5c7a8407e9bb5f8edba0c9045 2023-11-03 13:56:18,103 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103e7cd47c38d8f4020881bb613db5946c7_del 2023-11-03 13:56:18,103 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:18,105 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(139): Connect 0x40faa525 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:56:18,127 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@188fdbb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:56:18,129 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:18,129 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:18,130 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:19,008 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103525ce70417f14de483081d83cf4d7d91 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231103525ce70417f14de483081d83cf4d7d91 2023-11-03 13:56:19,008 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110306c27b630ca8482aa88d274d22ddfc08 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110306c27b630ca8482aa88d274d22ddfc08 2023-11-03 13:56:19,009 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,009 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,011 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103a587e7d150544c0485d4679779d6d130 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231103a587e7d150544c0485d4679779d6d130 2023-11-03 13:56:19,012 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,023 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:56:19,027 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:56:19,032 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:56:19,038 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:56:19,054 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231103/family1/64857a86e516415e91666bf247e2d044 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-03 13:56:19,054 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231103/family1/64857a86e516415e91666bf247e2d044}] 2023-11-03 13:56:19,064 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231103/family1/98ffddc6797f41f4a80e752b6d9316cc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-03 13:56:19,065 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231103/family1/98ffddc6797f41f4a80e752b6d9316cc}] 2023-11-03 13:56:19,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231103/family1/64857a86e516415e91666bf247e2d044 for inclusion in 7b948d6a87719f2b1cc30a04e963f90d/family1 2023-11-03 13:56:19,070 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231103/family1/98ffddc6797f41f4a80e752b6d9316cc for inclusion in cb8d8f1509b262c97e50f80367a86aa1/family1 2023-11-03 13:56:19,070 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/family1/e7cbc9a0d201452d83f3c8e640ad760c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-03 13:56:19,071 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/family1/e7cbc9a0d201452d83f3c8e640ad760c}] 2023-11-03 13:56:19,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-03 13:56:19,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-03 13:56:19,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:19,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231103/family1/64857a86e516415e91666bf247e2d044 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__ov7t8frsotupqilj8bdbqinig5jduojivru7h8hbe7mv1vtac84oq9n5l15qkcqi/family1/64857a86e516415e91666bf247e2d044 2023-11-03 13:56:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-03 13:56:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-03 13:56:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:19,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/family1/e7cbc9a0d201452d83f3c8e640ad760c for inclusion in c1dc363b0a4a8bd24f43f4db8cf648a2/family1 2023-11-03 13:56:19,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231103/family1/98ffddc6797f41f4a80e752b6d9316cc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__m594nd3kg4fehjfalfd351eaetqvj44t1cvmg1mbitsq09ni44dnt2fhivmasher/family1/98ffddc6797f41f4a80e752b6d9316cc 2023-11-03 13:56:19,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__ov7t8frsotupqilj8bdbqinig5jduojivru7h8hbe7mv1vtac84oq9n5l15qkcqi/family1/64857a86e516415e91666bf247e2d044 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/5c8d8a1dc2854c23bdedce0b8f59d88d_SeqId_28_ 2023-11-03 13:56:19,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__ov7t8frsotupqilj8bdbqinig5jduojivru7h8hbe7mv1vtac84oq9n5l15qkcqi/family1/64857a86e516415e91666bf247e2d044 into 7b948d6a87719f2b1cc30a04e963f90d/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/5c8d8a1dc2854c23bdedce0b8f59d88d_SeqId_28_ - updating store file list. 2023-11-03 13:56:19,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-03 13:56:19,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last=1 2023-11-03 13:56:19,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:19,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__m594nd3kg4fehjfalfd351eaetqvj44t1cvmg1mbitsq09ni44dnt2fhivmasher/family1/98ffddc6797f41f4a80e752b6d9316cc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/9f5ed691882d46c081d7039d58afc517_SeqId_28_ 2023-11-03 13:56:19,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/5c8d8a1dc2854c23bdedce0b8f59d88d_SeqId_28_ into 7b948d6a87719f2b1cc30a04e963f90d/family1 2023-11-03 13:56:19,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__ov7t8frsotupqilj8bdbqinig5jduojivru7h8hbe7mv1vtac84oq9n5l15qkcqi/family1/64857a86e516415e91666bf247e2d044 into 7b948d6a87719f2b1cc30a04e963f90d/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/family1/5c8d8a1dc2854c23bdedce0b8f59d88d_SeqId_28_) 2023-11-03 13:56:19,101 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__m594nd3kg4fehjfalfd351eaetqvj44t1cvmg1mbitsq09ni44dnt2fhivmasher/family1/98ffddc6797f41f4a80e752b6d9316cc into cb8d8f1509b262c97e50f80367a86aa1/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/9f5ed691882d46c081d7039d58afc517_SeqId_28_ - updating store file list. 2023-11-03 13:56:19,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__ov7t8frsotupqilj8bdbqinig5jduojivru7h8hbe7mv1vtac84oq9n5l15qkcqi/family1/64857a86e516415e91666bf247e2d044 2023-11-03 13:56:19,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231103/family1/e7cbc9a0d201452d83f3c8e640ad760c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__lpkqpepqpm75spsfdribl323kgd1vr338r9qop0ob8rrcbl55t9n28s369g95jhh/family1/e7cbc9a0d201452d83f3c8e640ad760c 2023-11-03 13:56:19,112 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,112 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/9f5ed691882d46c081d7039d58afc517_SeqId_28_ into cb8d8f1509b262c97e50f80367a86aa1/family1 2023-11-03 13:56:19,112 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__m594nd3kg4fehjfalfd351eaetqvj44t1cvmg1mbitsq09ni44dnt2fhivmasher/family1/98ffddc6797f41f4a80e752b6d9316cc into cb8d8f1509b262c97e50f80367a86aa1/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/family1/9f5ed691882d46c081d7039d58afc517_SeqId_28_) 2023-11-03 13:56:19,113 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:19,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__m594nd3kg4fehjfalfd351eaetqvj44t1cvmg1mbitsq09ni44dnt2fhivmasher/family1/98ffddc6797f41f4a80e752b6d9316cc 2023-11-03 13:56:19,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__lpkqpepqpm75spsfdribl323kgd1vr338r9qop0ob8rrcbl55t9n28s369g95jhh/family1/e7cbc9a0d201452d83f3c8e640ad760c as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/409fcfd8fe41418b81833b74d0872d35_SeqId_28_ 2023-11-03 13:56:19,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__lpkqpepqpm75spsfdribl323kgd1vr338r9qop0ob8rrcbl55t9n28s369g95jhh/family1/e7cbc9a0d201452d83f3c8e640ad760c into c1dc363b0a4a8bd24f43f4db8cf648a2/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/409fcfd8fe41418b81833b74d0872d35_SeqId_28_ - updating store file list. 2023-11-03 13:56:19,116 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311034bb76b59257e4a66afc29bb86009a29c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311034bb76b59257e4a66afc29bb86009a29c 2023-11-03 13:56:19,116 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-03 13:56:19,116 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231103' 2023-11-03 13:56:19,117 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:19,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/409fcfd8fe41418b81833b74d0872d35_SeqId_28_ into c1dc363b0a4a8bd24f43f4db8cf648a2/family1 2023-11-03 13:56:19,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__lpkqpepqpm75spsfdribl323kgd1vr338r9qop0ob8rrcbl55t9n28s369g95jhh/family1/e7cbc9a0d201452d83f3c8e640ad760c into c1dc363b0a4a8bd24f43f4db8cf648a2/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/family1/409fcfd8fe41418b81833b74d0872d35_SeqId_28_) 2023-11-03 13:56:19,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__ns_testMinorCompaction__lpkqpepqpm75spsfdribl323kgd1vr338r9qop0ob8rrcbl55t9n28s369g95jhh/family1/e7cbc9a0d201452d83f3c8e640ad760c 2023-11-03 13:56:19,124 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,127 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:19,127 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,131 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:19,133 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311034450485030fb46659f0a4dcfde737750 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311034450485030fb46659f0a4dcfde737750 2023-11-03 13:56:19,133 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-03 13:56:19,133 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231103' 2023-11-03 13:56:19,133 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231103dea840f207fe490e8eb2690c04995ff0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231103dea840f207fe490e8eb2690c04995ff0 2023-11-03 13:56:19,133 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-03 13:56:19,133 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231103' 2023-11-03 13:56:19,133 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:19,134 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231103 for table='ns:testMinorCompaction' and column='family1' 2023-11-03 13:56:19,134 INFO [Listener at localhost/39963] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-03 13:56:19,138 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:19,143 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:19,150 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:19,152 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:19,188 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=253 (was 288), OpenFileDescriptor=673 (was 779), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1019 (was 1001) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 198), AvailableMemoryMB=277 (was 226) - AvailableMemoryMB LEAK? - 2023-11-03 13:56:19,213 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=673, MaxFileDescriptor=60000, SystemLoadAverage=1019, ProcessCount=191, AvailableMemoryMB=275 2023-11-03 13:56:19,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-03 13:56:19,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:19,223 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:56:19,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-03 13:56:19,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:56:19,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:19,227 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709 2023-11-03 13:56:19,231 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709 empty. 2023-11-03 13:56:19,235 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709 2023-11-03 13:56:19,235 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-03 13:56:19,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:19,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:19,682 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-03 13:56:19,683 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 267647d419eb66138024b911f3fdb709, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:19,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:20,093 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:20,093 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 267647d419eb66138024b911f3fdb709, disabling compactions & flushes 2023-11-03 13:56:20,093 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,093 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,094 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. after waiting 0 ms 2023-11-03 13:56:20,094 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,094 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,094 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:20,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:56:20,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019780097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019780097"}]},"ts":"1699019780097"} 2023-11-03 13:56:20,098 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-03 13:56:20,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:56:20,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019780099"}]},"ts":"1699019780099"} 2023-11-03 13:56:20,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-03 13:56:20,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=267647d419eb66138024b911f3fdb709, ASSIGN}] 2023-11-03 13:56:20,333 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=267647d419eb66138024b911f3fdb709, ASSIGN 2023-11-03 13:56:20,334 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=267647d419eb66138024b911f3fdb709, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:20,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:20,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=267647d419eb66138024b911f3fdb709, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:20,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019780485"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019780485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019780485"}]},"ts":"1699019780485"} 2023-11-03 13:56:20,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 267647d419eb66138024b911f3fdb709, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:20,639 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:20,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 267647d419eb66138024b911f3fdb709, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.', STARTKEY => '', ENDKEY => ''} 2023-11-03 13:56:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,644 INFO [StoreOpener-267647d419eb66138024b911f3fdb709-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,646 DEBUG [StoreOpener-267647d419eb66138024b911f3fdb709-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:20,646 DEBUG [StoreOpener-267647d419eb66138024b911f3fdb709-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:20,647 INFO [StoreOpener-267647d419eb66138024b911f3fdb709-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 267647d419eb66138024b911f3fdb709 columnFamilyName family1 2023-11-03 13:56:20,648 INFO [StoreOpener-267647d419eb66138024b911f3fdb709-1] regionserver.HStore(310): Store=267647d419eb66138024b911f3fdb709/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:20,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:20,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:20,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 267647d419eb66138024b911f3fdb709; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63648988, jitterRate=-0.051556169986724854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-03 13:56:20,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:20,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., pid=114, masterSystemTime=1699019780639 2023-11-03 13:56:20,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:20,655 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=267647d419eb66138024b911f3fdb709, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:20,655 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699019780655"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019780655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019780655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019780655"}]},"ts":"1699019780655"} 2023-11-03 13:56:20,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-03 13:56:20,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 267647d419eb66138024b911f3fdb709, server=jenkins-hbase20.apache.org,46707,1699019650288 in 171 msec 2023-11-03 13:56:20,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-03 13:56:20,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=267647d419eb66138024b911f3fdb709, ASSIGN in 327 msec 2023-11-03 13:56:20,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:56:20,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019780660"}]},"ts":"1699019780660"} 2023-11-03 13:56:20,661 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-03 13:56:20,663 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:56:20,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.4440 sec 2023-11-03 13:56:20,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:21,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-03 13:56:21,335 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-03 13:56:21,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:21,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,358 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:21,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:21,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:21,358 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:21,359 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,359 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,361 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:21,361 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:21,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:21,362 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,362 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:21,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:21,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,370 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:21,370 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:21,370 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:21,373 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:21,373 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:21,373 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:21,373 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:21,373 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-03 13:56:21,398 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f7178dd707b34c66940f8e1feee1fa0c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7178dd707b34c66940f8e1feee1fa0c 2023-11-03 13:56:21,801 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/3db506865d3045ad883d8ef9346031d3 2023-11-03 13:56:21,806 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/3db506865d3045ad883d8ef9346031d3 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3 2023-11-03 13:56:21,809 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-03 13:56:21,810 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 437ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:21,811 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:21,811 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:21,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:21,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:21,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:21,811 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:21,813 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,813 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:21,813 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,813 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:21,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:21,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38650c13[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:21,814 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:21,814 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,815 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,815 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:21,815 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:21,815 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,815 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:21,815 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:21,816 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:21,816 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:21,816 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,816 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:21,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:21,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:21,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:21,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:21,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:21,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:21,819 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:21,819 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:21,819 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:21,819 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,819 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:21,820 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,820 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:21,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,820 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:21,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:21,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,821 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:21,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,824 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:21,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:21,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:21,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:21,835 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,836 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:21,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:21,835 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:21,836 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:21,836 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:21,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:21,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:21,936 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:21,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:21,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:21,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:21,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,942 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:21,942 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:21,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:21,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:21,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,943 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,946 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:21,946 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,946 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:21,946 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:21,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:21,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:21,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:21,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:21,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:21,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:21,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:21,947 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:21,947 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:21,947 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-03 13:56:22,369 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128206c8e51a341471e85777173dfd2bb7d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128206c8e51a341471e85777173dfd2bb7d 2023-11-03 13:56:22,374 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2 2023-11-03 13:56:22,379 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2 2023-11-03 13:56:22,383 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2, entries=1, sequenceid=9, filesize=5.0 K 2023-11-03 13:56:22,384 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 437ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:22,384 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:22,384 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:22,384 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:22,384 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:22,385 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,385 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:22,385 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:22,386 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,386 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:22,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d6a85e[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:22,388 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:22,388 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,388 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,389 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:22,389 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:22,389 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:22,396 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,396 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:22,402 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:22,402 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:22,402 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,402 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:22,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:22,405 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:22,405 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:22,405 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:22,405 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,405 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:22,411 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,411 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,411 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:22,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:22,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,414 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,416 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:22,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,419 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,419 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:22,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:22,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:22,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:22,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:22,420 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:22,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:22,420 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:22,520 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:22,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:22,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:22,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:22,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,528 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:22,528 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:22,528 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:22,528 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:22,528 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,528 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,529 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,529 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:22,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:22,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,530 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,530 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:22,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,531 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,531 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:22,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:22,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:22,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:22,534 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:22,534 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:22,534 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:22,534 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:22,534 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:22,549 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201072fa136957c455aa7c67701b50d205e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201072fa136957c455aa7c67701b50d205e 2023-11-03 13:56:22,954 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/a9067f076cf549cb816df1ed9474653a 2023-11-03 13:56:22,958 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/a9067f076cf549cb816df1ed9474653a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a 2023-11-03 13:56:22,962 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a, entries=1, sequenceid=13, filesize=4.9 K 2023-11-03 13:56:22,963 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 429ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:22,963 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:22,964 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:22,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:22,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:22,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:22,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:22,965 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,965 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:22,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b9b5fb9[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:22,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:22,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,968 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:22,968 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:22,968 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:22,968 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,968 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:22,969 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:22,969 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:22,969 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:22,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:22,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:22,981 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:22,981 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:22,981 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:22,981 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,981 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:22,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:22,986 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:22,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:22,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,988 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,996 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:22,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:22,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:22,996 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:22,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:22,997 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:22,997 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:22,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:22,997 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:22,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:23,097 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:23,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:23,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:23,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:23,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,104 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:23,104 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:23,104 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:23,104 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:23,105 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,105 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,106 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:23,106 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:23,107 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,107 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:23,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:23,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,108 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:23,108 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:23,108 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:23,108 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:23,108 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:23,108 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:23,108 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:23,108 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:23,538 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120545e63962f12245e082ebb261b437b7a1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120545e63962f12245e082ebb261b437b7a1 2023-11-03 13:56:23,944 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/ef46a3ee8e37444d852822fe6e200001 2023-11-03 13:56:23,950 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/ef46a3ee8e37444d852822fe6e200001 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001 2023-11-03 13:56:23,954 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001, entries=1, sequenceid=17, filesize=4.9 K 2023-11-03 13:56:23,956 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 848ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:23,956 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:23,956 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:23,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:23,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:23,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:23,956 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:23,959 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,959 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:23,960 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,960 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:23,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:23,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5207776[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:23,962 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:23,962 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:23,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:23,963 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:23,963 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,963 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:23,964 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:23,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:23,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:23,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:23,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:23,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:23,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:23,967 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:23,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:23,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:23,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,967 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:23,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:23,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,970 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,971 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,985 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:23,985 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:23,985 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:23,985 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:23,985 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:23,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:23,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:23,986 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:24,086 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:24,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:24,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:24,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:24,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,095 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:24,095 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:24,095 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:24,095 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:24,101 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,102 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,103 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:24,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,105 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:24,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:24,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:24,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:24,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:24,112 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:24,112 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:24,114 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:24,114 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:24,114 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:24,118 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,118 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:24,221 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288eaa0c5d687647d78c132e41d70d3df6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288eaa0c5d687647d78c132e41d70d3df6 2023-11-03 13:56:24,672 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/301b34c3576747e583288c62ef285a4e 2023-11-03 13:56:24,679 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/301b34c3576747e583288c62ef285a4e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e 2023-11-03 13:56:24,684 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e, entries=1, sequenceid=21, filesize=4.9 K 2023-11-03 13:56:24,685 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 571ms, sequenceid=21, compaction requested=true 2023-11-03 13:56:24,685 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:24,685 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:24,685 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:24,685 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:24,685 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,685 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:24,685 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:24,686 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,687 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:24,688 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,688 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:24,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:24,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15b5e655[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:24,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:24,689 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,690 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,691 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:24,691 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:24,691 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:24,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,691 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:24,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:24,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:24,692 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:24,692 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:24,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:24,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:24,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:24,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:24,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:24,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:24,696 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:24,696 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:24,696 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:24,696 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,696 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:24,710 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,710 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,710 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:24,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:24,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:24,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:24,711 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:24,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,713 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:24,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:24,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:24,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,719 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:24,719 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:24,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:24,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:24,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:24,820 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:24,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:24,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:24,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:24,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,830 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:24,830 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:24,830 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:24,830 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:24,838 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,838 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,846 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:24,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:24,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,849 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,850 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:24,851 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,858 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:24,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:24,862 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:24,862 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:24,862 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:24,863 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:24,863 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:24,863 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:24,863 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:24,863 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:24,994 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317636433522b74208ad71c333665d18e1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512317636433522b74208ad71c333665d18e1 2023-11-03 13:56:25,480 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/febb64ef98ee4b3f935c18ed2389d52a 2023-11-03 13:56:25,486 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/febb64ef98ee4b3f935c18ed2389d52a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a 2023-11-03 13:56:25,491 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-03 13:56:25,492 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 629ms, sequenceid=25, compaction requested=true 2023-11-03 13:56:25,492 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:25,492 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:25,493 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:25,494 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:25,494 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,494 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:25,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:25,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@251138e5[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:25,496 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:25,496 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,499 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,499 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:25,499 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,499 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:25,499 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:25,499 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:25,500 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:25,500 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:25,500 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,500 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:25,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:25,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:25,504 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:25,504 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:25,504 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:25,504 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,504 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:25,505 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,505 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:25,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,505 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:25,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:25,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:25,506 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:25,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,508 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,510 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:25,510 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:25,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:25,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:25,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:25,511 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,511 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:25,611 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:25,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:25,616 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:25,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:25,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,622 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:25,622 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:25,622 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:25,622 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:25,630 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,630 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,634 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:25,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:25,638 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:25,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:25,641 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:25,641 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:25,641 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:25,642 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:25,642 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:25,646 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:25,646 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:25,649 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:25,649 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:25,649 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:26,091 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101940fd09459be4d2ca237ead531336513 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101940fd09459be4d2ca237ead531336513 2023-11-03 13:56:26,211 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:56:26,514 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/536bd3c2c6114ad19c46f5f0148f5b5e 2023-11-03 13:56:26,520 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/536bd3c2c6114ad19c46f5f0148f5b5e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e 2023-11-03 13:56:26,529 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e, entries=1, sequenceid=29, filesize=4.9 K 2023-11-03 13:56:26,530 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 881ms, sequenceid=29, compaction requested=true 2023-11-03 13:56:26,530 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:26,530 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:26,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:26,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:26,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:26,531 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:26,532 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,532 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:26,532 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,532 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:26,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:26,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24f6dd69[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:26,534 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:26,534 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,535 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,535 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:26,535 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,535 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:26,535 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:26,535 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:26,536 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:26,536 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:26,537 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:26,537 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:26,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:26,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:26,540 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:26,540 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:26,540 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:26,540 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,540 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:26,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,541 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:26,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,542 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:26,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,542 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:26,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,544 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:26,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:26,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:26,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:26,546 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:26,547 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,547 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,547 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,547 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:26,547 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:26,547 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:26,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:26,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:26,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:26,548 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:26,548 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:26,648 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:26,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:26,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:26,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:26,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,657 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:26,657 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:26,657 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:26,657 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:26,659 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,659 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,662 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:26,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:26,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:26,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,663 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,664 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,666 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:26,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:26,666 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:26,666 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:26,666 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:26,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:26,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:26,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:26,667 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:26,667 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:26,667 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:26,669 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:27,136 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ab5e96c8928149b5ba70688cf36f594d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab5e96c8928149b5ba70688cf36f594d 2023-11-03 13:56:27,562 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/cbafd1421e204f4f843161103164f2d9 2023-11-03 13:56:27,567 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/cbafd1421e204f4f843161103164f2d9 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9 2023-11-03 13:56:27,570 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9, entries=1, sequenceid=33, filesize=4.9 K 2023-11-03 13:56:27,571 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 902ms, sequenceid=33, compaction requested=true 2023-11-03 13:56:27,571 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:27,571 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:27,571 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:27,571 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:27,571 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,571 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:27,571 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:27,572 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,573 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:27,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226b8546[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:27,575 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:27,575 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,575 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,576 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:27,576 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:27,576 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:27,576 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,576 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:27,576 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:27,577 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,577 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,577 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:27,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:27,580 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:27,580 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:27,580 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:27,580 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,580 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:27,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:27,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,581 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,582 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,584 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:27,586 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:27,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:27,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:27,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:27,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:27,586 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:27,687 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:27,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:27,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:27,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:27,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,693 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:27,693 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:27,693 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:27,693 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:27,694 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,694 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,696 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:27,696 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,697 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,697 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:27,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:27,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,704 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:27,705 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:27,705 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:27,705 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:27,705 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:27,706 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:27,706 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:27,706 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:27,757 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e2dbae066d204425a89275f04a788021 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907e2dbae066d204425a89275f04a788021 2023-11-03 13:56:27,790 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/53fc9b530ddd4b1784a3a66e5fed1e8b 2023-11-03 13:56:27,810 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/53fc9b530ddd4b1784a3a66e5fed1e8b as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b 2023-11-03 13:56:27,817 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b, entries=1, sequenceid=37, filesize=4.9 K 2023-11-03 13:56:27,822 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 116ms, sequenceid=37, compaction requested=true 2023-11-03 13:56:27,823 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:27,823 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:27,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:27,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:27,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:27,823 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:27,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,827 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:27,830 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:27,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18d64810[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:27,833 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:27,833 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,844 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,844 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:27,844 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,844 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:27,844 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:27,844 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:27,845 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:27,846 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:27,846 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:27,846 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:27,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:27,851 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:27,851 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:27,851 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:27,851 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,851 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:27,852 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,852 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:27,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,853 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:27,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:27,853 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,855 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:27,857 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:27,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:27,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:27,858 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:27,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:27,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:27,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:27,858 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:27,858 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:27,959 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:27,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:27,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,966 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:27,966 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:27,966 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-03 13:56:27,966 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-03 13:56:27,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,969 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,973 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,974 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:27,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:27,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:27,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,977 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:27,977 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:27,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,982 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-03 13:56:27,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:27,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-03 13:56:27,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:27,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-03 13:56:27,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-03 13:56:27,986 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:27,987 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:27,987 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. started... 2023-11-03 13:56:27,987 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 267647d419eb66138024b911f3fdb709 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-03 13:56:28,033 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120858ee5d8754547e7af4bd660ad42e6a9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120858ee5d8754547e7af4bd660ad42e6a9 2023-11-03 13:56:28,054 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/e471839992964c7da7a63b1dfd03be91 2023-11-03 13:56:28,082 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/e471839992964c7da7a63b1dfd03be91 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91 2023-11-03 13:56:28,103 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91, entries=1, sequenceid=41, filesize=4.9 K 2023-11-03 13:56:28,104 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 267647d419eb66138024b911f3fdb709 in 117ms, sequenceid=41, compaction requested=true 2023-11-03 13:56:28,104 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:28,104 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:28,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-03 13:56:28,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-03 13:56:28,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-03 13:56:28,105 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-03 13:56:28,106 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,106 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:28,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:28,106 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,107 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:28,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:28,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:28,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:28,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-03 13:56:28,108 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-03 13:56:28,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@342c8dff[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:28,108 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,109 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-03 13:56:28,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-03 13:56:28,109 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:28,109 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,109 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:28,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-03 13:56:28,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:28,110 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-03 13:56:28,110 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:28,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:28,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:28,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:28,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:28,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:28,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-03 13:56:28,113 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-03 13:56:28,114 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:28,114 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:28,114 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,114 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:28,119 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,119 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,119 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:28,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:28,120 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,122 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,127 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:28,127 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:28,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:28,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:28,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:28,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,128 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:28,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-03 13:56:28,128 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,129 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-03 13:56:28,129 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:28,129 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:28,129 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:28,229 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:28,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:28,232 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-03 13:56:28,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:56:28,234 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:56:28,235 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020388235 2023-11-03 13:56:28,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:56:28,238 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-03 13:56:28,239 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-03 13:56:28,239 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:28,241 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x6e1ada49 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:56:28,270 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a7aa43b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:56:28,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:28,727 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cf40168cce3c40cc83c22ba75da94328 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cf40168cce3c40cc83c22ba75da94328 2023-11-03 13:56:28,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:28,754 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:56:28,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:56:28,779 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:56:28,781 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:56:28,796 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cc094a1943ac454b82dc17653c2b1ac4 first=Optional[r5] last=Optional[r6] 2023-11-03 13:56:28,797 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cc094a1943ac454b82dc17653c2b1ac4}] 2023-11-03 13:56:28,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cc094a1943ac454b82dc17653c2b1ac4 for inclusion in 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-03 13:56:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:56:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:28,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cc094a1943ac454b82dc17653c2b1ac4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fkvusvhrfro7mojtesn9es3j7b661qrdjrcfki0ep7aib61981n06jq2ogi2urgp/family1/cc094a1943ac454b82dc17653c2b1ac4 2023-11-03 13:56:28,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fkvusvhrfro7mojtesn9es3j7b661qrdjrcfki0ep7aib61981n06jq2ogi2urgp/family1/cc094a1943ac454b82dc17653c2b1ac4 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_ 2023-11-03 13:56:28,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fkvusvhrfro7mojtesn9es3j7b661qrdjrcfki0ep7aib61981n06jq2ogi2urgp/family1/cc094a1943ac454b82dc17653c2b1ac4 into 267647d419eb66138024b911f3fdb709/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_ - updating store file list. 2023-11-03 13:56:28,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_ into 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:28,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fkvusvhrfro7mojtesn9es3j7b661qrdjrcfki0ep7aib61981n06jq2ogi2urgp/family1/cc094a1943ac454b82dc17653c2b1ac4 into 267647d419eb66138024b911f3fdb709/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_) 2023-11-03 13:56:28,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fkvusvhrfro7mojtesn9es3j7b661qrdjrcfki0ep7aib61981n06jq2ogi2urgp/family1/cc094a1943ac454b82dc17653c2b1ac4 2023-11-03 13:56:28,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-03 13:56:28,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-03 13:56:28,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 267647d419eb66138024b911f3fdb709/family1 is initiating minor compaction 2023-11-03 13:56:28,818 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 267647d419eb66138024b911f3fdb709/family1 in testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:28,819 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp, totalSize=49.7 K 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting faaac2c5b57c4b698b1ed7c4c98bd0b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting a9067f076cf549cb816df1ed9474653a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting ef46a3ee8e37444d852822fe6e200001, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 301b34c3576747e583288c62ef285a4e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting febb64ef98ee4b3f935c18ed2389d52a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 536bd3c2c6114ad19c46f5f0148f5b5e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting cbafd1421e204f4f843161103164f2d9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 53fc9b530ddd4b1784a3a66e5fed1e8b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting e471839992964c7da7a63b1dfd03be91, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-03 13:56:28,819 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting cc77185f26034c8d838314a53df51105_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-03 13:56:28,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@644d508b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:28,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:28,822 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:28,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101940fd09459be4d2ca237ead531336513 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101940fd09459be4d2ca237ead531336513 2023-11-03 13:56:28,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab5e96c8928149b5ba70688cf36f594d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab5e96c8928149b5ba70688cf36f594d 2023-11-03 13:56:28,828 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-03 13:56:28,828 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-03 13:56:28,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:28,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:28,857 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 267647d419eb66138024b911f3fdb709#family1#compaction#165 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-03 13:56:29,300 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/5e4dcbefb2c1407eaa72596a4d0212da as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/5e4dcbefb2c1407eaa72596a4d0212da 2023-11-03 13:56:29,312 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 267647d419eb66138024b911f3fdb709/family1 of 267647d419eb66138024b911f3fdb709 into 5e4dcbefb2c1407eaa72596a4d0212da(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:29,312 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:29,312 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699019788818; duration=0sec 2023-11-03 13:56:29,312 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:29,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_] to archive 2023-11-03 13:56:29,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:29,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/faaac2c5b57c4b698b1ed7c4c98bd0b2 2023-11-03 13:56:29,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/a9067f076cf549cb816df1ed9474653a 2023-11-03 13:56:29,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ef46a3ee8e37444d852822fe6e200001 2023-11-03 13:56:29,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/301b34c3576747e583288c62ef285a4e 2023-11-03 13:56:29,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/febb64ef98ee4b3f935c18ed2389d52a 2023-11-03 13:56:29,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/536bd3c2c6114ad19c46f5f0148f5b5e 2023-11-03 13:56:29,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cbafd1421e204f4f843161103164f2d9 2023-11-03 13:56:29,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/53fc9b530ddd4b1784a3a66e5fed1e8b 2023-11-03 13:56:29,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/e471839992964c7da7a63b1dfd03be91 2023-11-03 13:56:29,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/cc77185f26034c8d838314a53df51105_SeqId_44_ 2023-11-03 13:56:29,694 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310c5e4f86cf2747bf9e3bce72d35c3262 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310c5e4f86cf2747bf9e3bce72d35c3262 2023-11-03 13:56:29,696 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:29,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed first=Optional[r1] last=Optional[r4] 2023-11-03 13:56:29,789 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed}] 2023-11-03 13:56:29,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed for inclusion in 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:29,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-03 13:56:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:56:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:29,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dddg5a3ndf30a0vsv9b35i0so560889lkb18oouud23jq81d9nrbg1aas6beonb7/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed 2023-11-03 13:56:29,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dddg5a3ndf30a0vsv9b35i0so560889lkb18oouud23jq81d9nrbg1aas6beonb7/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_ 2023-11-03 13:56:29,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dddg5a3ndf30a0vsv9b35i0so560889lkb18oouud23jq81d9nrbg1aas6beonb7/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed into 267647d419eb66138024b911f3fdb709/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_ - updating store file list. 2023-11-03 13:56:29,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_ into 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:29,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dddg5a3ndf30a0vsv9b35i0so560889lkb18oouud23jq81d9nrbg1aas6beonb7/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed into 267647d419eb66138024b911f3fdb709/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_) 2023-11-03 13:56:29,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dddg5a3ndf30a0vsv9b35i0so560889lkb18oouud23jq81d9nrbg1aas6beonb7/family1/cf2d5bbc4e304fb1be039bf62d3eb6ed 2023-11-03 13:56:29,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-03 13:56:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-03 13:56:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(1912): 267647d419eb66138024b911f3fdb709/family1 is initiating minor compaction (all files) 2023-11-03 13:56:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3b448537; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:29,880 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 267647d419eb66138024b911f3fdb709/family1 in testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:29,880 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/5e4dcbefb2c1407eaa72596a4d0212da, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp, totalSize=178.1 K 2023-11-03 13:56:29,881 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 3db506865d3045ad883d8ef9346031d3, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878817029 2023-11-03 13:56:29,886 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 5e4dcbefb2c1407eaa72596a4d0212da, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621217029 2023-11-03 13:56:29,890 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] compactions.Compactor(207): Compacting 26e1de5cbd11456da01f1fb981da07f5_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965217029 2023-11-03 13:56:29,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:29,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:29,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201072fa136957c455aa7c67701b50d205e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201072fa136957c455aa7c67701b50d205e 2023-11-03 13:56:29,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120545e63962f12245e082ebb261b437b7a1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120545e63962f12245e082ebb261b437b7a1 2023-11-03 13:56:29,932 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288eaa0c5d687647d78c132e41d70d3df6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288eaa0c5d687647d78c132e41d70d3df6 2023-11-03 13:56:29,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512317636433522b74208ad71c333665d18e1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512317636433522b74208ad71c333665d18e1 2023-11-03 13:56:29,939 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-03 13:56:29,939 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-03 13:56:29,942 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:29,942 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:29,955 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] throttle.PressureAwareThroughputController(145): 267647d419eb66138024b911f3fdb709#family1#compaction#166 average throughput is 6.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-03 13:56:30,530 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301d59377652ea46a6b05b26d319cad542 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301d59377652ea46a6b05b26d319cad542 2023-11-03 13:56:30,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:30,645 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2c4f2461e7694424922b90cd53e69290 first=Optional[r00] last=Optional[r8] 2023-11-03 13:56:30,647 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2c4f2461e7694424922b90cd53e69290}] 2023-11-03 13:56:30,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2c4f2461e7694424922b90cd53e69290 for inclusion in 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-03 13:56:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last= 2023-11-03 13:56:30,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:30,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2c4f2461e7694424922b90cd53e69290 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d095h631vmtvbfpcsb74lc1bqfs4lf6b9c10352pcpkn6tuphc1adciqf3qt4ia7/family1/2c4f2461e7694424922b90cd53e69290 2023-11-03 13:56:30,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d095h631vmtvbfpcsb74lc1bqfs4lf6b9c10352pcpkn6tuphc1adciqf3qt4ia7/family1/2c4f2461e7694424922b90cd53e69290 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ffebb94d55314576a2c32f76333fc558_SeqId_49_ 2023-11-03 13:56:30,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d095h631vmtvbfpcsb74lc1bqfs4lf6b9c10352pcpkn6tuphc1adciqf3qt4ia7/family1/2c4f2461e7694424922b90cd53e69290 into 267647d419eb66138024b911f3fdb709/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ffebb94d55314576a2c32f76333fc558_SeqId_49_ - updating store file list. 2023-11-03 13:56:30,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ffebb94d55314576a2c32f76333fc558_SeqId_49_ into 267647d419eb66138024b911f3fdb709/family1 2023-11-03 13:56:30,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d095h631vmtvbfpcsb74lc1bqfs4lf6b9c10352pcpkn6tuphc1adciqf3qt4ia7/family1/2c4f2461e7694424922b90cd53e69290 into 267647d419eb66138024b911f3fdb709/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/ffebb94d55314576a2c32f76333fc558_SeqId_49_) 2023-11-03 13:56:30,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d095h631vmtvbfpcsb74lc1bqfs4lf6b9c10352pcpkn6tuphc1adciqf3qt4ia7/family1/2c4f2461e7694424922b90cd53e69290 2023-11-03 13:56:30,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:30,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:30,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120858ee5d8754547e7af4bd660ad42e6a9 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120858ee5d8754547e7af4bd660ad42e6a9 2023-11-03 13:56:30,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128206c8e51a341471e85777173dfd2bb7d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128206c8e51a341471e85777173dfd2bb7d 2023-11-03 13:56:30,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7178dd707b34c66940f8e1feee1fa0c to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7178dd707b34c66940f8e1feee1fa0c 2023-11-03 13:56:30,754 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-03 13:56:30,754 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-03 13:56:30,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:30,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:30,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-03 13:56:30,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-03 13:56:30,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:56:30,767 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-03 13:56:30,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.5350 sec 2023-11-03 13:56:31,252 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/.tmp/family1/1d44c51790d44d3d961168e344e4ffaa as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/1d44c51790d44d3d961168e344e4ffaa 2023-11-03 13:56:31,284 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 267647d419eb66138024b911f3fdb709/family1 of 267647d419eb66138024b911f3fdb709 into 1d44c51790d44d3d961168e344e4ffaa(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:31,284 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:31,284 INFO [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699019789880; duration=1sec 2023-11-03 13:56:31,284 DEBUG [RS:0;jenkins-hbase20:46707-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-03 13:56:31,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/5e4dcbefb2c1407eaa72596a4d0212da, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_] to archive 2023-11-03 13:56:31,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:31,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/3db506865d3045ad883d8ef9346031d3 2023-11-03 13:56:31,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/5e4dcbefb2c1407eaa72596a4d0212da to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/5e4dcbefb2c1407eaa72596a4d0212da 2023-11-03 13:56:31,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_ to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/family1/26e1de5cbd11456da01f1fb981da07f5_SeqId_47_ 2023-11-03 13:56:31,915 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=259 (was 253) - Thread LEAK? -, OpenFileDescriptor=687 (was 673) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1136 (was 1019) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 191), AvailableMemoryMB=268 (was 275) 2023-11-03 13:56:31,937 INFO [Listener at localhost/39963] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=259, OpenFileDescriptor=687, MaxFileDescriptor=60000, SystemLoadAverage=1136, ProcessCount=190, AvailableMemoryMB=267 2023-11-03 13:56:31,963 DEBUG [Listener at localhost/39963] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-03 13:56:32,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10LS\x0D\xC6\x0E\xF7@*iZU\x10\xAD\xB6uJ"\x10\xD1\x184}o?O\xE2\xA3\xA4\x1A\x0C\x1C\xD3\x8C\xBC*\x10\xA2$7"d\xB2!}!\x97\xE1\xC1\xAC8a\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-03 13:56:32,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-03 13:56:32,058 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-03 13:56:32,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-03 13:56:32,059 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-03 13:56:32,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-03 13:56:32,062 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,062 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,062 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:32,063 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398 empty. 2023-11-03 13:56:32,065 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b empty. 2023-11-03 13:56:32,065 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc empty. 2023-11-03 13:56:32,066 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,068 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:32,069 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-03 13:56:32,120 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-03 13:56:32,125 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => ecc419573e8aff484d42f90a993a2398, NAME => 'testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10LS\x0D\xC6\x0E\xF7@*iZU\x10\xAD\xB6uJ"\x10\xD1\x184}o?O\xE2\xA3\xA4\x1A\x0C\x1C\xD3\x8C\xBC*\x10\xA2$7"d\xB2!}!\x97\xE1\xC1\xAC8a\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:32,126 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7dcaa53e14ef59d58a71971a814fc4cc, NAME => 'testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10LS\x0D\xC6\x0E\xF7@*iZU\x10\xAD\xB6uJ"\x10\xD1\x184}o?O\xE2\xA3\xA4\x1A\x0C\x1C\xD3\x8C\xBC*\x10\xA2$7"d\xB2!}!\x97\xE1\xC1\xAC8a\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:32,127 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 11eb07e0192fd9953208b402ac78964b, NAME => 'testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10LS\x0D\xC6\x0E\xF7@*iZU\x10\xAD\xB6uJ"\x10\xD1\x184}o?O\xE2\xA3\xA4\x1A\x0C\x1C\xD3\x8C\xBC*\x10\xA2$7"d\xB2!}!\x97\xE1\xC1\xAC8a\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/.tmp 2023-11-03 13:56:32,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 7dcaa53e14ef59d58a71971a814fc4cc, disabling compactions & flushes 2023-11-03 13:56:32,223 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. after waiting 0 ms 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:32,223 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:32,223 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:32,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing ecc419573e8aff484d42f90a993a2398, disabling compactions & flushes 2023-11-03 13:56:32,551 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. after waiting 0 ms 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,551 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,551 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:32,581 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:32,581 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 11eb07e0192fd9953208b402ac78964b, disabling compactions & flushes 2023-11-03 13:56:32,581 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:32,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:32,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. after waiting 0 ms 2023-11-03 13:56:32,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:32,582 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:32,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:32,584 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-03 13:56:32,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699019792585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019792585"}]},"ts":"1699019792585"} 2023-11-03 13:56:32,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019792585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019792585"}]},"ts":"1699019792585"} 2023-11-03 13:56:32,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019792585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699019792585"}]},"ts":"1699019792585"} 2023-11-03 13:56:32,589 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-03 13:56:32,590 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-03 13:56:32,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019792590"}]},"ts":"1699019792590"} 2023-11-03 13:56:32,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-03 13:56:32,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ecc419573e8aff484d42f90a993a2398, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7dcaa53e14ef59d58a71971a814fc4cc, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=11eb07e0192fd9953208b402ac78964b, ASSIGN}] 2023-11-03 13:56:32,597 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ecc419573e8aff484d42f90a993a2398, ASSIGN 2023-11-03 13:56:32,597 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=11eb07e0192fd9953208b402ac78964b, ASSIGN 2023-11-03 13:56:32,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7dcaa53e14ef59d58a71971a814fc4cc, ASSIGN 2023-11-03 13:56:32,598 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ecc419573e8aff484d42f90a993a2398, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:32,599 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=11eb07e0192fd9953208b402ac78964b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:32,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7dcaa53e14ef59d58a71971a814fc4cc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46707,1699019650288; forceNewPlan=false, retain=false 2023-11-03 13:56:32,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-03 13:56:32,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7dcaa53e14ef59d58a71971a814fc4cc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:32,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ecc419573e8aff484d42f90a993a2398, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:32,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699019792750"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019792750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019792750"}]},"ts":"1699019792750"} 2023-11-03 13:56:32,751 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019792750"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019792750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019792750"}]},"ts":"1699019792750"} 2023-11-03 13:56:32,751 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=11eb07e0192fd9953208b402ac78964b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:32,751 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019792751"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699019792751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699019792751"}]},"ts":"1699019792751"} 2023-11-03 13:56:32,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 7dcaa53e14ef59d58a71971a814fc4cc, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:32,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure ecc419573e8aff484d42f90a993a2398, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:32,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 11eb07e0192fd9953208b402ac78964b, server=jenkins-hbase20.apache.org,46707,1699019650288}] 2023-11-03 13:56:32,906 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:32,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecc419573e8aff484d42f90a993a2398, NAME => 'testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.', STARTKEY => '', ENDKEY => '1'} 2023-11-03 13:56:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,943 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,944 DEBUG [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1 2023-11-03 13:56:32,945 DEBUG [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1 2023-11-03 13:56:32,945 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecc419573e8aff484d42f90a993a2398 columnFamilyName family1 2023-11-03 13:56:32,946 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] regionserver.HStore(310): Store=ecc419573e8aff484d42f90a993a2398/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:32,946 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,947 DEBUG [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2 2023-11-03 13:56:32,947 DEBUG [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2 2023-11-03 13:56:32,947 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecc419573e8aff484d42f90a993a2398 columnFamilyName family2 2023-11-03 13:56:32,949 INFO [StoreOpener-ecc419573e8aff484d42f90a993a2398-1] regionserver.HStore(310): Store=ecc419573e8aff484d42f90a993a2398/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:32,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:32,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ecc419573e8aff484d42f90a993a2398; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71567270, jitterRate=0.06643542647361755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:32,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:32,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398., pid=121, masterSystemTime=1699019792906 2023-11-03 13:56:32,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:32,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7dcaa53e14ef59d58a71971a814fc4cc, NAME => 'testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.', STARTKEY => '1', ENDKEY => '2'} 2023-11-03 13:56:32,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ecc419573e8aff484d42f90a993a2398, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:32,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019792957"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019792957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019792957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019792957"}]},"ts":"1699019792957"} 2023-11-03 13:56:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-11-03 13:56:32,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure ecc419573e8aff484d42f90a993a2398, server=jenkins-hbase20.apache.org,46707,1699019650288 in 207 msec 2023-11-03 13:56:32,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ecc419573e8aff484d42f90a993a2398, ASSIGN in 369 msec 2023-11-03 13:56:32,986 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,988 DEBUG [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1 2023-11-03 13:56:32,988 DEBUG [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1 2023-11-03 13:56:32,988 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dcaa53e14ef59d58a71971a814fc4cc columnFamilyName family1 2023-11-03 13:56:32,989 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] regionserver.HStore(310): Store=7dcaa53e14ef59d58a71971a814fc4cc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:32,990 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,991 DEBUG [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2 2023-11-03 13:56:32,991 DEBUG [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2 2023-11-03 13:56:32,991 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dcaa53e14ef59d58a71971a814fc4cc columnFamilyName family2 2023-11-03 13:56:32,992 INFO [StoreOpener-7dcaa53e14ef59d58a71971a814fc4cc-1] regionserver.HStore(310): Store=7dcaa53e14ef59d58a71971a814fc4cc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:32,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:32,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:32,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7dcaa53e14ef59d58a71971a814fc4cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68868918, jitterRate=0.026226848363876343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:33,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc., pid=120, masterSystemTime=1699019792906 2023-11-03 13:56:33,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:33,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:33,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:33,003 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7dcaa53e14ef59d58a71971a814fc4cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11eb07e0192fd9953208b402ac78964b, NAME => 'testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.', STARTKEY => '2', ENDKEY => ''} 2023-11-03 13:56:33,003 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699019793002"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019793002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019793002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019793002"}]},"ts":"1699019793002"} 2023-11-03 13:56:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-03 13:56:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-11-03 13:56:33,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 7dcaa53e14ef59d58a71971a814fc4cc, server=jenkins-hbase20.apache.org,46707,1699019650288 in 252 msec 2023-11-03 13:56:33,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7dcaa53e14ef59d58a71971a814fc4cc, ASSIGN in 413 msec 2023-11-03 13:56:33,034 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,036 DEBUG [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1 2023-11-03 13:56:33,036 DEBUG [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1 2023-11-03 13:56:33,036 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11eb07e0192fd9953208b402ac78964b columnFamilyName family1 2023-11-03 13:56:33,037 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] regionserver.HStore(310): Store=11eb07e0192fd9953208b402ac78964b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:33,037 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,039 DEBUG [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2 2023-11-03 13:56:33,039 DEBUG [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2 2023-11-03 13:56:33,039 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11eb07e0192fd9953208b402ac78964b columnFamilyName family2 2023-11-03 13:56:33,040 INFO [StoreOpener-11eb07e0192fd9953208b402ac78964b-1] regionserver.HStore(310): Store=11eb07e0192fd9953208b402ac78964b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-03 13:56:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-03 13:56:33,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:33,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-03 13:56:33,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 11eb07e0192fd9953208b402ac78964b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71751842, jitterRate=0.0691857635974884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-03 13:56:33,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:33,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b., pid=122, masterSystemTime=1699019792906 2023-11-03 13:56:33,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:33,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:33,047 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=11eb07e0192fd9953208b402ac78964b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,047 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699019793047"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699019793047"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699019793047"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699019793047"}]},"ts":"1699019793047"} 2023-11-03 13:56:33,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-03 13:56:33,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 11eb07e0192fd9953208b402ac78964b, server=jenkins-hbase20.apache.org,46707,1699019650288 in 294 msec 2023-11-03 13:56:33,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-03 13:56:33,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=11eb07e0192fd9953208b402ac78964b, ASSIGN in 455 msec 2023-11-03 13:56:33,050 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-03 13:56:33,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699019793051"}]},"ts":"1699019793051"} 2023-11-03 13:56:33,051 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-03 13:56:33,053 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-03 13:56:33,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.0010 sec 2023-11-03 13:56:33,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-03 13:56:33,165 INFO [Listener at localhost/39963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-03 13:56:33,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:33,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:33,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:33,172 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-03 13:56:33,174 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-03 13:56:33,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:33,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-03 13:56:33,174 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-03 13:56:33,175 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,175 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:33,175 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:33,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:33,175 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:33,176 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:33,176 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:33,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:33,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-03 13:56:33,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-03 13:56:33,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-03 13:56:33,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:33,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-03 13:56:33,177 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:33,177 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. started... 2023-11-03 13:56:33,177 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:33,177 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. started... 2023-11-03 13:56:33,177 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:33,178 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:33,178 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:33,178 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 11eb07e0192fd9953208b402ac78964b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:33,178 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ecc419573e8aff484d42f90a993a2398 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:33,178 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. started... 2023-11-03 13:56:33,179 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7dcaa53e14ef59d58a71971a814fc4cc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-03 13:56:33,240 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103421267fb92a14351a759338917b3c0af to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103421267fb92a14351a759338917b3c0af 2023-11-03 13:56:33,247 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311038547250def944e4ca8b0f60111873994 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311038547250def944e4ca8b0f60111873994 2023-11-03 13:56:33,258 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311035c653d5dfd19428390065ca8a42b7de7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035c653d5dfd19428390065ca8a42b7de7 2023-11-03 13:56:33,276 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/ac5e168ad7c24d3a98105e5b32d22a97 2023-11-03 13:56:33,278 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/46776b3bcb8845d588f368bb762603d2 2023-11-03 13:56:33,280 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/e4a6b6b7e8f04fb0b02d1658aacde613 2023-11-03 13:56:33,324 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110397eeb0bba49240378e86dcc28c85e3e2 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110397eeb0bba49240378e86dcc28c85e3e2 2023-11-03 13:56:33,727 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103cec0d1ed13fc45af96ace1deae7ba179 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231103cec0d1ed13fc45af96ace1deae7ba179 2023-11-03 13:56:33,730 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/70297307dccc48118c993825a09f260e 2023-11-03 13:56:33,731 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103d260d4d21a084e4eb67d7b5d0f724420 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231103d260d4d21a084e4eb67d7b5d0f724420 2023-11-03 13:56:33,751 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/46776b3bcb8845d588f368bb762603d2 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2 2023-11-03 13:56:33,755 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/c642feb3a822453caff9a122c2e8f45f 2023-11-03 13:56:33,774 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/647482eea51d4cd3b2153efa92c7105a 2023-11-03 13:56:33,807 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/e4a6b6b7e8f04fb0b02d1658aacde613 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613 2023-11-03 13:56:33,815 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/ac5e168ad7c24d3a98105e5b32d22a97 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97 2023-11-03 13:56:33,816 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2, entries=4, sequenceid=5, filesize=5.5 K 2023-11-03 13:56:33,842 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/70297307dccc48118c993825a09f260e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e 2023-11-03 13:56:33,882 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:33,888 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97, entries=4, sequenceid=5, filesize=5.5 K 2023-11-03 13:56:33,890 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ecc419573e8aff484d42f90a993a2398 in 712ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:33,890 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-03 13:56:33,891 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:33,891 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:33,894 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/c642feb3a822453caff9a122c2e8f45f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f 2023-11-03 13:56:33,894 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:33,919 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613, entries=4, sequenceid=5, filesize=5.5 K 2023-11-03 13:56:33,920 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/647482eea51d4cd3b2153efa92c7105a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a 2023-11-03 13:56:33,925 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:33,926 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 11eb07e0192fd9953208b402ac78964b in 747ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:33,927 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:33,927 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:33,927 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:33,938 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-03 13:56:33,939 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7dcaa53e14ef59d58a71971a814fc4cc in 760ms, sequenceid=5, compaction requested=false 2023-11-03 13:56:33,939 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:33,939 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-03 13:56:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-03 13:56:33,944 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,944 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:33,945 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,945 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:33,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-03 13:56:33,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26a30386[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:33,946 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-03 13:56:33,946 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,947 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-03 13:56:33,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-03 13:56:33,947 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:33,948 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,948 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:33,964 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-03 13:56:33,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:33,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:33,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:33,964 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-03 13:56:33,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:33,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-03 13:56:33,967 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-03 13:56:33,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:33,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:33,967 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-03 13:56:33,967 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:33,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,969 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:33,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:33,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:33,970 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,971 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,977 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-03 13:56:33,977 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:33,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:33,978 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:33,977 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:33,977 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:33,978 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:33,978 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:33,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-03 13:56:33,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:34,078 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:34,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:34,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:34,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:34,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:34,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:34,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:34,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-03 13:56:34,087 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-03 13:56:34,087 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:34,087 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-03 13:56:34,087 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-03 13:56:34,090 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:34,090 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:34,092 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:34,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:34,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:34,092 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:34,093 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:34,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:34,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-03 13:56:34,094 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-03 13:56:34,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-03 13:56:34,094 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-03 13:56:34,094 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:34,094 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-03 13:56:34,094 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:34,094 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. started... 2023-11-03 13:56:34,094 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:34,094 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 11eb07e0192fd9953208b402ac78964b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:34,094 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. started... 2023-11-03 13:56:34,094 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ecc419573e8aff484d42f90a993a2398 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:34,098 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:34,098 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:34,102 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:34,102 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. started... 2023-11-03 13:56:34,103 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7dcaa53e14ef59d58a71971a814fc4cc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-03 13:56:34,267 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311038e4e379a64fe4ecb9f1c7d85ddc36049 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311038e4e379a64fe4ecb9f1c7d85ddc36049 2023-11-03 13:56:34,299 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103683dee6065884ab9ba3f10266882a6ae to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103683dee6065884ab9ba3f10266882a6ae 2023-11-03 13:56:34,378 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/13e3d4c721d549cfa0b31c20a70d0d31 2023-11-03 13:56:34,508 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110371e6fc4471ba450ba4c6777c2cca7fef to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110371e6fc4471ba450ba4c6777c2cca7fef 2023-11-03 13:56:34,550 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/59d3bd28a2544c28b725837d37ca1a3a 2023-11-03 13:56:34,604 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/13e3d4c721d549cfa0b31c20a70d0d31 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31 2023-11-03 13:56:34,645 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31, entries=4, sequenceid=9, filesize=5.5 K 2023-11-03 13:56:34,647 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103601e5b5cbc6b4539bc5b0b4360bada98 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103601e5b5cbc6b4539bc5b0b4360bada98 2023-11-03 13:56:34,648 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/59d3bd28a2544c28b725837d37ca1a3a as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a 2023-11-03 13:56:34,671 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:34,671 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7dcaa53e14ef59d58a71971a814fc4cc in 569ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:34,672 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:34,672 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:34,672 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:34,795 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/2eead0419de349b28d92e8234d87eb09 2023-11-03 13:56:35,095 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/329c96b6561248a284a1794186b1afbb 2023-11-03 13:56:35,329 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110372af8a1c79dc4b7fb9ad6e2a06adc723 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110372af8a1c79dc4b7fb9ad6e2a06adc723 2023-11-03 13:56:35,382 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/89f256a61e3b4e93a8417003b17f74ef 2023-11-03 13:56:35,431 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/2eead0419de349b28d92e8234d87eb09 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09 2023-11-03 13:56:35,507 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09, entries=4, sequenceid=9, filesize=5.5 K 2023-11-03 13:56:35,509 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/89f256a61e3b4e93a8417003b17f74ef as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef 2023-11-03 13:56:35,522 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:35,526 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ecc419573e8aff484d42f90a993a2398 in 1432ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:35,527 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:35,527 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:35,527 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:35,664 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311033df492161d2f40a1917d11e76f7f2271 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311033df492161d2f40a1917d11e76f7f2271 2023-11-03 13:56:36,122 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/b19c5bac06e54b0da8fd253506694bc3 2023-11-03 13:56:36,128 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/329c96b6561248a284a1794186b1afbb as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb 2023-11-03 13:56:36,215 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb, entries=4, sequenceid=9, filesize=5.5 K 2023-11-03 13:56:36,216 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/b19c5bac06e54b0da8fd253506694bc3 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3 2023-11-03 13:56:36,245 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-03 13:56:36,246 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 11eb07e0192fd9953208b402ac78964b in 2152ms, sequenceid=9, compaction requested=false 2023-11-03 13:56:36,246 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:36,246 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:36,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:36,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:36,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-03 13:56:36,246 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-03 13:56:36,257 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,257 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,257 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:36,262 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:36,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:36,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-03 13:56:36,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@589ce3a1[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:36,287 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-03 13:56:36,287 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,291 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,291 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,291 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:36,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,294 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-03 13:56:36,294 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-03 13:56:36,294 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:36,302 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-03 13:56:36,302 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:36,302 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-03 13:56:36,318 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:36,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-03 13:56:36,324 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-03 13:56:36,324 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:36,324 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:36,324 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-03 13:56:36,324 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:36,329 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,329 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:36,329 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:36,330 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,334 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:36,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,353 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,353 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:36,353 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:36,353 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,354 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,354 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:36,354 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,354 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:36,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-03 13:56:36,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:36,354 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:36,354 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:36,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-03 13:56:36,358 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:36,359 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:36,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:36,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:36,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-03 13:56:36,458 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:36,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:36,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:36,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:36,471 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:36,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:36,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-03 13:56:36,490 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-03 13:56:36,490 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:36,490 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-03 13:56:36,491 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-03 13:56:36,498 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,498 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:36,507 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,508 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:36,508 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:36,510 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:36,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:36,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:36,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:36,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-03 13:56:36,528 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-03 13:56:36,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-03 13:56:36,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-03 13:56:36,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:36,530 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-03 13:56:36,531 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:36,531 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. started... 2023-11-03 13:56:36,531 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 11eb07e0192fd9953208b402ac78964b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:36,539 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:36,539 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. started... 2023-11-03 13:56:36,540 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ecc419573e8aff484d42f90a993a2398 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:36,540 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:36,540 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:36,540 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:36,540 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. started... 2023-11-03 13:56:36,540 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7dcaa53e14ef59d58a71971a814fc4cc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-03 13:56:37,154 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103d70b239c9a864659b5cc57f45fa21fe1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103d70b239c9a864659b5cc57f45fa21fe1 2023-11-03 13:56:37,200 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103473c03a06c494285a99f0b8037b22163 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103473c03a06c494285a99f0b8037b22163 2023-11-03 13:56:37,207 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110318a65a82f6cc4784be1177410d216eab to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110318a65a82f6cc4784be1177410d216eab 2023-11-03 13:56:37,639 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/785e02dc9f8d44fe8b5e4db28fe377bf 2023-11-03 13:56:37,723 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/9fe6dcbcec064c0299827372cf7205b0 2023-11-03 13:56:37,726 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/0ad09976d0f34795a2bba6ec43d980b6 2023-11-03 13:56:37,779 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311036a5eb0ddbb524c29bcbf998ba91aa7bf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311036a5eb0ddbb524c29bcbf998ba91aa7bf 2023-11-03 13:56:37,936 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311034d4e160563384d77af7b2f93b2af0629 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311034d4e160563384d77af7b2f93b2af0629 2023-11-03 13:56:37,953 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103571121eb8489473ba687ceb4a501c841 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231103571121eb8489473ba687ceb4a501c841 2023-11-03 13:56:37,977 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/8204f53615894fcc875f976dba4eeb1f 2023-11-03 13:56:38,021 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/0ad09976d0f34795a2bba6ec43d980b6 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6 2023-11-03 13:56:38,080 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:56:38,080 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e1ada49 to 127.0.0.1:53668 2023-11-03 13:56:38,081 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:38,081 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:56:38,081 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40faa525 to 127.0.0.1:53668 2023-11-03 13:56:38,081 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:38,155 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6, entries=4, sequenceid=13, filesize=5.5 K 2023-11-03 13:56:38,166 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/8204f53615894fcc875f976dba4eeb1f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f 2023-11-03 13:56:38,192 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:38,194 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ecc419573e8aff484d42f90a993a2398 in 1654ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:38,194 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:38,194 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:38,194 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:38,266 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/f11e2c43e3284627a26c5ce4e05397cf 2023-11-03 13:56:38,302 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/785e02dc9f8d44fe8b5e4db28fe377bf as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf 2023-11-03 13:56:38,364 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf, entries=4, sequenceid=13, filesize=5.5 K 2023-11-03 13:56:38,374 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/f11e2c43e3284627a26c5ce4e05397cf as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf 2023-11-03 13:56:38,414 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/795d5830340548d480eb047a64b08869 2023-11-03 13:56:38,425 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:38,426 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 11eb07e0192fd9953208b402ac78964b in 1895ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:38,426 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:38,426 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:38,426 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:38,479 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/9fe6dcbcec064c0299827372cf7205b0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0 2023-11-03 13:56:38,548 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0, entries=4, sequenceid=13, filesize=5.5 K 2023-11-03 13:56:38,559 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/795d5830340548d480eb047a64b08869 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869 2023-11-03 13:56:38,587 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-03 13:56:38,591 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869, entries=2, sequenceid=13, filesize=5.1 K 2023-11-03 13:56:38,592 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7dcaa53e14ef59d58a71971a814fc4cc in 2052ms, sequenceid=13, compaction requested=true 2023-11-03 13:56:38,592 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:38,592 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:38,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:38,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:38,592 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-03 13:56:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-03 13:56:38,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,606 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:38,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,606 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:38,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-03 13:56:38,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72a0a66a[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:38,608 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-03 13:56:38,609 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,610 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-03 13:56:38,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-03 13:56:38,610 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:38,611 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,611 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:38,612 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-03 13:56:38,612 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,612 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:38,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:38,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:38,612 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-03 13:56:38,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:38,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:38,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-03 13:56:38,647 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-03 13:56:38,648 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:38,648 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:38,648 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-03 13:56:38,648 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:38,656 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,656 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,659 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:38,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:38,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:38,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:38,667 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,697 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,733 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:38,734 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:38,738 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:38,739 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:38,740 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:38,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-03 13:56:38,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:38,741 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:38,741 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:38,843 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:38,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:38,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:38,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:38,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-03 13:56:38,856 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:38,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:38,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-03 13:56:38,874 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-03 13:56:38,874 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:38,874 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-03 13:56:38,874 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-03 13:56:38,877 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,877 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:38,883 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:38,883 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:38,892 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:38,892 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:38,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:38,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-03 13:56:38,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-03 13:56:38,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-03 13:56:38,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-03 13:56:38,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:38,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-03 13:56:38,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:38,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. started... 2023-11-03 13:56:38,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:38,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. started... 2023-11-03 13:56:38,896 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 11eb07e0192fd9953208b402ac78964b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:38,896 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ecc419573e8aff484d42f90a993a2398 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:38,897 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:38,897 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:38,897 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:38,897 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. started... 2023-11-03 13:56:38,897 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7dcaa53e14ef59d58a71971a814fc4cc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-03 13:56:39,008 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103f148dfbefe9f49dcb989fb7b9389416b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103f148dfbefe9f49dcb989fb7b9389416b 2023-11-03 13:56:39,060 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311035e22ceb425514634a89ae865f7e706d3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035e22ceb425514634a89ae865f7e706d3 2023-11-03 13:56:39,071 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311033a995cfac1ba415cbac899a4e9ba3660 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311033a995cfac1ba415cbac899a4e9ba3660 2023-11-03 13:56:39,076 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/0dc96e7edaa24969aafe06eb5002a42d 2023-11-03 13:56:39,125 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/d7b03cd0bf5a482594592c81fd7154bd 2023-11-03 13:56:39,137 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/62dc75ee69244d988827d27b5db33edc 2023-11-03 13:56:39,250 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103fb3b8a92eea54e03835411330887a4a0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231103fb3b8a92eea54e03835411330887a4a0 2023-11-03 13:56:39,279 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/033652c98f1f45cc8f2d069bfa38d4b4 2023-11-03 13:56:39,287 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110386ab41bcfc9a4087b0b24c6366b6655e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110386ab41bcfc9a4087b0b24c6366b6655e 2023-11-03 13:56:39,313 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/0dc96e7edaa24969aafe06eb5002a42d as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d 2023-11-03 13:56:39,327 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110384850899aa5741ccb1a1717d53a96dbc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110384850899aa5741ccb1a1717d53a96dbc 2023-11-03 13:56:39,363 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-03 13:56:39,373 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/033652c98f1f45cc8f2d069bfa38d4b4 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4 2023-11-03 13:56:39,404 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:39,407 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ecc419573e8aff484d42f90a993a2398 in 511ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:39,407 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:39,407 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:39,410 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:39,716 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/11d9c676570a445891a33ab07edd798f 2023-11-03 13:56:39,752 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/d7b03cd0bf5a482594592c81fd7154bd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd 2023-11-03 13:56:39,774 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/2835979a8f0f4f5296847667f443489e 2023-11-03 13:56:39,803 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd, entries=4, sequenceid=17, filesize=5.5 K 2023-11-03 13:56:39,804 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/11d9c676570a445891a33ab07edd798f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f 2023-11-03 13:56:39,805 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/62dc75ee69244d988827d27b5db33edc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc 2023-11-03 13:56:39,848 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:39,854 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 11eb07e0192fd9953208b402ac78964b in 958ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:39,855 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:39,855 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:39,855 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:39,880 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc, entries=4, sequenceid=17, filesize=5.5 K 2023-11-03 13:56:39,882 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/2835979a8f0f4f5296847667f443489e as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e 2023-11-03 13:56:39,895 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-03 13:56:39,896 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7dcaa53e14ef59d58a71971a814fc4cc in 999ms, sequenceid=17, compaction requested=true 2023-11-03 13:56:39,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:39,896 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:39,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:39,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:39,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-03 13:56:39,896 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-03 13:56:39,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:39,910 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:39,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:39,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:39,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-03 13:56:39,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22b39eb4[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:39,947 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-03 13:56:39,947 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,949 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:39,949 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-03 13:56:39,949 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-03 13:56:39,949 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:39,950 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-03 13:56:39,950 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:39,950 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-03 13:56:39,951 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:39,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-03 13:56:39,954 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,954 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:39,954 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-03 13:56:39,954 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:39,954 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:39,954 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-03 13:56:39,954 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:39,967 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:39,968 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:39,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:39,978 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,999 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:40,016 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:40,016 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:40,017 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:40,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-03 13:56:40,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:40,017 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:40,017 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-03 13:56:40,020 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:40,020 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:40,020 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:40,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:40,121 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:40,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:40,145 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:40,165 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:40,180 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:40,181 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:40,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-03 13:56:40,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-03 13:56:40,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-03 13:56:40,406 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-03 13:56:40,406 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:40,407 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-03 13:56:40,407 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-03 13:56:40,408 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:40,408 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:40,410 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:40,410 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:40,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:40,411 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:40,411 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-03 13:56:40,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-03 13:56:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:40,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-03 13:56:40,412 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-03 13:56:40,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-03 13:56:40,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-03 13:56:40,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-03 13:56:40,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. started... 2023-11-03 13:56:40,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:40,412 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 11eb07e0192fd9953208b402ac78964b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. started... 2023-11-03 13:56:40,412 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-03 13:56:40,413 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7dcaa53e14ef59d58a71971a814fc4cc 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:40,412 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. started... 2023-11-03 13:56:40,413 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ecc419573e8aff484d42f90a993a2398 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-03 13:56:40,954 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/3117c3adb50b4805a8927e8a0e8514ef 2023-11-03 13:56:40,962 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/f5f065a96fd84fe8a7589df0e32abfbf 2023-11-03 13:56:40,979 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/fe56913dcd0e40028c8595dcaf23cd55 2023-11-03 13:56:41,058 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3117c3adb50b4805a8927e8a0e8514ef 2023-11-03 13:56:41,077 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5f065a96fd84fe8a7589df0e32abfbf 2023-11-03 13:56:41,078 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe56913dcd0e40028c8595dcaf23cd55 2023-11-03 13:56:41,614 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/240ce16e84fb4caf82aedc976190d9e0 2023-11-03 13:56:41,629 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 240ce16e84fb4caf82aedc976190d9e0 2023-11-03 13:56:41,630 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/3117c3adb50b4805a8927e8a0e8514ef as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef 2023-11-03 13:56:41,651 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/d40716ba4e4c472fb43ab56b53de15ee 2023-11-03 13:56:41,663 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40716ba4e4c472fb43ab56b53de15ee 2023-11-03 13:56:41,666 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/669f0ea491b84d20ad0b088a2ffad1ee 2023-11-03 13:56:41,667 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/fe56913dcd0e40028c8595dcaf23cd55 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55 2023-11-03 13:56:41,696 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3117c3adb50b4805a8927e8a0e8514ef 2023-11-03 13:56:41,696 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef, entries=3, sequenceid=23, filesize=5.2 K 2023-11-03 13:56:41,701 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/240ce16e84fb4caf82aedc976190d9e0 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0 2023-11-03 13:56:41,715 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 669f0ea491b84d20ad0b088a2ffad1ee 2023-11-03 13:56:41,730 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/f5f065a96fd84fe8a7589df0e32abfbf as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf 2023-11-03 13:56:41,738 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 240ce16e84fb4caf82aedc976190d9e0 2023-11-03 13:56:41,738 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:41,743 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 11eb07e0192fd9953208b402ac78964b in 1331ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:41,744 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:41,744 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:41,744 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-03 13:56:41,757 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe56913dcd0e40028c8595dcaf23cd55 2023-11-03 13:56:41,757 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55, entries=3, sequenceid=23, filesize=5.2 K 2023-11-03 13:56:41,787 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/d40716ba4e4c472fb43ab56b53de15ee as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee 2023-11-03 13:56:41,793 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5f065a96fd84fe8a7589df0e32abfbf 2023-11-03 13:56:41,793 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf, entries=3, sequenceid=23, filesize=5.2 K 2023-11-03 13:56:41,810 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/669f0ea491b84d20ad0b088a2ffad1ee as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee 2023-11-03 13:56:41,842 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40716ba4e4c472fb43ab56b53de15ee 2023-11-03 13:56:41,842 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:41,850 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ecc419573e8aff484d42f90a993a2398 in 1437ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:41,851 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:41,851 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:41,854 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-03 13:56:41,863 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 669f0ea491b84d20ad0b088a2ffad1ee 2023-11-03 13:56:41,863 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee, entries=1, sequenceid=23, filesize=5.0 K 2023-11-03 13:56:41,867 INFO [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7dcaa53e14ef59d58a71971a814fc4cc in 1454ms, sequenceid=23, compaction requested=true 2023-11-03 13:56:41,867 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:41,867 DEBUG [rs(jenkins-hbase20.apache.org,46707,1699019650288)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:41,868 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-03 13:56:41,868 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-03 13:56:41,868 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,868 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-03 13:56:41,868 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-03 13:56:41,898 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:41,898 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:41,906 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,906 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-03 13:56:41,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46707,1699019650288' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-03 13:56:41,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cb21657[Count = 0] remaining members to acquire global barrier 2023-11-03 13:56:41,910 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-03 13:56:41,910 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,912 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,912 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-03 13:56:41,914 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,914 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-03 13:56:41,915 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-03 13:56:41,915 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,46707,1699019650288' in zk 2023-11-03 13:56:41,927 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-03 13:56:41,927 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:41,927 DEBUG [member: 'jenkins-hbase20.apache.org,46707,1699019650288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-03 13:56:41,927 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,46707,1699019650288': 2023-11-03 13:56:41,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46707,1699019650288' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-03 13:56:41,932 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-03 13:56:41,932 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-03 13:56:41,932 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-03 13:56:41,932 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-03 13:56:41,932 INFO [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-03 13:56:41,935 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,935 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:41,935 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-03 13:56:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-03 13:56:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-03 13:56:41,937 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:41,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-03 13:56:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,951 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-03 13:56:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-03 13:56:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-03 13:56:41,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-03 13:56:41,962 DEBUG [(jenkins-hbase20.apache.org,45993,1699019647783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-03 13:56:41,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-03 13:56:41,962 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-03 13:56:41,963 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-03 13:56:41,963 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-03 13:56:41,963 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-03 13:56:41,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-03 13:56:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-03 13:56:41,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-03 13:56:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-03 13:56:42,064 DEBUG [Listener at localhost/39963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-03 13:56:42,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45993] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-03 13:56:42,065 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:42,066 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 11eb07e0192fd9953208b402ac78964b/family1 is initiating major compaction (all files) 2023-11-03 13:56:42,066 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:42,066 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:42,067 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 11eb07e0192fd9953208b402ac78964b/family1 in testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:42,068 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp, totalSize=27.1 K 2023-11-03 13:56:42,068 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting ac5e168ad7c24d3a98105e5b32d22a97, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:42,074 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 329c96b6561248a284a1794186b1afbb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794081 2023-11-03 13:56:42,079 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 785e02dc9f8d44fe8b5e4db28fe377bf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796462 2023-11-03 13:56:42,082 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting d7b03cd0bf5a482594592c81fd7154bd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798848 2023-11-03 13:56:42,083 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 3117c3adb50b4805a8927e8a0e8514ef, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:42,105 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 11eb07e0192fd9953208b402ac78964b#family1#compaction#197 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:42,228 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del 2023-11-03 13:56:42,228 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del 2023-11-03 13:56:42,760 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d09eb3148e24866a52c7006bd087852 2023-11-03 13:56:42,763 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family1/8d09eb3148e24866a52c7006bd087852 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/8d09eb3148e24866a52c7006bd087852 2023-11-03 13:56:42,812 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d09eb3148e24866a52c7006bd087852 2023-11-03 13:56:42,814 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 11eb07e0192fd9953208b402ac78964b/family1 of 11eb07e0192fd9953208b402ac78964b into 8d09eb3148e24866a52c7006bd087852(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:42,814 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:42,814 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:42,814 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 11eb07e0192fd9953208b402ac78964b/family2 is initiating major compaction (all files) 2023-11-03 13:56:42,814 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:42,814 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:42,815 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 11eb07e0192fd9953208b402ac78964b/family2 in testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:42,815 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp, totalSize=25.4 K 2023-11-03 13:56:42,827 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting c642feb3a822453caff9a122c2e8f45f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:42,838 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting b19c5bac06e54b0da8fd253506694bc3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794081 2023-11-03 13:56:42,841 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting f11e2c43e3284627a26c5ce4e05397cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796462 2023-11-03 13:56:42,844 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 11d9c676570a445891a33ab07edd798f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798848 2023-11-03 13:56:42,847 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 240ce16e84fb4caf82aedc976190d9e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:42,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef] to archive 2023-11-03 13:56:42,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:42,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/ac5e168ad7c24d3a98105e5b32d22a97 2023-11-03 13:56:42,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/329c96b6561248a284a1794186b1afbb 2023-11-03 13:56:42,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/785e02dc9f8d44fe8b5e4db28fe377bf 2023-11-03 13:56:42,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/d7b03cd0bf5a482594592c81fd7154bd 2023-11-03 13:56:42,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/3117c3adb50b4805a8927e8a0e8514ef 2023-11-03 13:56:42,955 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 11eb07e0192fd9953208b402ac78964b#family2#compaction#198 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:42,990 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311032f8289abc0894a7580d3d0ecd186480d_del 2023-11-03 13:56:42,991 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311032f8289abc0894a7580d3d0ecd186480d_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311032f8289abc0894a7580d3d0ecd186480d_del 2023-11-03 13:56:43,916 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90fc15d8d73b4fa1a7d5ef3b64f0a6a4 2023-11-03 13:56:43,924 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/.tmp/family2/90fc15d8d73b4fa1a7d5ef3b64f0a6a4 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/90fc15d8d73b4fa1a7d5ef3b64f0a6a4 2023-11-03 13:56:43,934 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90fc15d8d73b4fa1a7d5ef3b64f0a6a4 2023-11-03 13:56:43,936 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 11eb07e0192fd9953208b402ac78964b/family2 of 11eb07e0192fd9953208b402ac78964b into 90fc15d8d73b4fa1a7d5ef3b64f0a6a4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:43,936 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:43,936 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:43,936 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): ecc419573e8aff484d42f90a993a2398/family1 is initiating major compaction (all files) 2023-11-03 13:56:43,936 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:43,937 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:43,937 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of ecc419573e8aff484d42f90a993a2398/family1 in testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:43,937 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp, totalSize=27.1 K 2023-11-03 13:56:43,939 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 46776b3bcb8845d588f368bb762603d2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:43,940 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 2eead0419de349b28d92e8234d87eb09, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794080 2023-11-03 13:56:43,941 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 0ad09976d0f34795a2bba6ec43d980b6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796461 2023-11-03 13:56:43,941 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 0dc96e7edaa24969aafe06eb5002a42d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798847 2023-11-03 13:56:43,941 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting fe56913dcd0e40028c8595dcaf23cd55, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:43,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0] to archive 2023-11-03 13:56:43,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:43,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/c642feb3a822453caff9a122c2e8f45f 2023-11-03 13:56:43,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/b19c5bac06e54b0da8fd253506694bc3 2023-11-03 13:56:44,000 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): ecc419573e8aff484d42f90a993a2398#family1#compaction#199 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:44,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/f11e2c43e3284627a26c5ce4e05397cf 2023-11-03 13:56:44,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/11d9c676570a445891a33ab07edd798f 2023-11-03 13:56:44,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family2/240ce16e84fb4caf82aedc976190d9e0 2023-11-03 13:56:44,468 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del 2023-11-03 13:56:44,468 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del 2023-11-03 13:56:44,983 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4229c3ac8f64454a9193ac6747a7f7c2 2023-11-03 13:56:44,984 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family1/4229c3ac8f64454a9193ac6747a7f7c2 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/4229c3ac8f64454a9193ac6747a7f7c2 2023-11-03 13:56:45,021 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4229c3ac8f64454a9193ac6747a7f7c2 2023-11-03 13:56:45,023 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ecc419573e8aff484d42f90a993a2398/family1 of ecc419573e8aff484d42f90a993a2398 into 4229c3ac8f64454a9193ac6747a7f7c2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:45,023 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:45,023 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:45,023 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): ecc419573e8aff484d42f90a993a2398/family2 is initiating major compaction (all files) 2023-11-03 13:56:45,023 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:45,023 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:45,025 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of ecc419573e8aff484d42f90a993a2398/family2 in testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:45,025 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp, totalSize=25.4 K 2023-11-03 13:56:45,026 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 70297307dccc48118c993825a09f260e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:45,027 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 89f256a61e3b4e93a8417003b17f74ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794080 2023-11-03 13:56:45,027 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 8204f53615894fcc875f976dba4eeb1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796461 2023-11-03 13:56:45,027 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 033652c98f1f45cc8f2d069bfa38d4b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798847 2023-11-03 13:56:45,028 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting d40716ba4e4c472fb43ab56b53de15ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:45,038 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): ecc419573e8aff484d42f90a993a2398#family2#compaction#200 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:45,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55] to archive 2023-11-03 13:56:45,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:45,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/46776b3bcb8845d588f368bb762603d2 2023-11-03 13:56:45,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/2eead0419de349b28d92e8234d87eb09 2023-11-03 13:56:45,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0ad09976d0f34795a2bba6ec43d980b6 2023-11-03 13:56:45,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/0dc96e7edaa24969aafe06eb5002a42d 2023-11-03 13:56:45,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/fe56913dcd0e40028c8595dcaf23cd55 2023-11-03 13:56:45,462 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110320a1041fd74a491ead4019c5b38bbec9_del 2023-11-03 13:56:45,462 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110320a1041fd74a491ead4019c5b38bbec9_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110320a1041fd74a491ead4019c5b38bbec9_del 2023-11-03 13:56:45,897 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cadace4e928b4f9296af7c041bc57bdd 2023-11-03 13:56:45,901 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/.tmp/family2/cadace4e928b4f9296af7c041bc57bdd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/cadace4e928b4f9296af7c041bc57bdd 2023-11-03 13:56:45,915 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cadace4e928b4f9296af7c041bc57bdd 2023-11-03 13:56:45,922 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ecc419573e8aff484d42f90a993a2398/family2 of ecc419573e8aff484d42f90a993a2398 into cadace4e928b4f9296af7c041bc57bdd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:45,923 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:45,923 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:45,923 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 7dcaa53e14ef59d58a71971a814fc4cc/family1 is initiating major compaction (all files) 2023-11-03 13:56:45,923 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:45,923 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:45,923 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 7dcaa53e14ef59d58a71971a814fc4cc/family1 in testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:45,923 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp, totalSize=27.1 K 2023-11-03 13:56:45,927 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting e4a6b6b7e8f04fb0b02d1658aacde613, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:45,927 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 13e3d4c721d549cfa0b31c20a70d0d31, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794081 2023-11-03 13:56:45,928 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 9fe6dcbcec064c0299827372cf7205b0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796462 2023-11-03 13:56:45,928 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 62dc75ee69244d988827d27b5db33edc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798847 2023-11-03 13:56:45,929 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting f5f065a96fd84fe8a7589df0e32abfbf, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:45,951 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 7dcaa53e14ef59d58a71971a814fc4cc#family1#compaction#201 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:45,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee] to archive 2023-11-03 13:56:45,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:45,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/70297307dccc48118c993825a09f260e 2023-11-03 13:56:45,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/89f256a61e3b4e93a8417003b17f74ef 2023-11-03 13:56:46,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/8204f53615894fcc875f976dba4eeb1f 2023-11-03 13:56:46,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/033652c98f1f45cc8f2d069bfa38d4b4 2023-11-03 13:56:46,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family2/d40716ba4e4c472fb43ab56b53de15ee 2023-11-03 13:56:46,416 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del 2023-11-03 13:56:46,416 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del 2023-11-03 13:56:46,930 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 655216ea738049528d2609040d25ccbd 2023-11-03 13:56:46,931 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family1/655216ea738049528d2609040d25ccbd as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/655216ea738049528d2609040d25ccbd 2023-11-03 13:56:46,967 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 655216ea738049528d2609040d25ccbd 2023-11-03 13:56:46,969 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7dcaa53e14ef59d58a71971a814fc4cc/family1 of 7dcaa53e14ef59d58a71971a814fc4cc into 655216ea738049528d2609040d25ccbd(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-03 13:56:46,969 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:46,969 DEBUG [Listener at localhost/39963] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-03 13:56:46,969 DEBUG [Listener at localhost/39963] regionserver.HStore(1912): 7dcaa53e14ef59d58a71971a814fc4cc/family2 is initiating major compaction (all files) 2023-11-03 13:56:46,969 INFO [Listener at localhost/39963] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-03 13:56:46,970 INFO [Listener at localhost/39963] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-03 13:56:46,971 INFO [Listener at localhost/39963] regionserver.HRegion(2259): Starting compaction of 7dcaa53e14ef59d58a71971a814fc4cc/family2 in testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:46,971 INFO [Listener at localhost/39963] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee] into tmpdir=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp, totalSize=25.4 K 2023-11-03 13:56:46,972 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 647482eea51d4cd3b2153efa92c7105a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699019793170 2023-11-03 13:56:46,972 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 59d3bd28a2544c28b725837d37ca1a3a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699019794081 2023-11-03 13:56:46,972 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 795d5830340548d480eb047a64b08869, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699019796462 2023-11-03 13:56:46,973 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 2835979a8f0f4f5296847667f443489e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699019798847 2023-11-03 13:56:46,973 DEBUG [Listener at localhost/39963] compactions.Compactor(207): Compacting 669f0ea491b84d20ad0b088a2ffad1ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-03 13:56:46,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf] to archive 2023-11-03 13:56:46,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:46,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/e4a6b6b7e8f04fb0b02d1658aacde613 2023-11-03 13:56:46,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/13e3d4c721d549cfa0b31c20a70d0d31 2023-11-03 13:56:46,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/9fe6dcbcec064c0299827372cf7205b0 2023-11-03 13:56:46,989 INFO [Listener at localhost/39963] throttle.PressureAwareThroughputController(145): 7dcaa53e14ef59d58a71971a814fc4cc#family2#compaction#202 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-03 13:56:46,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/62dc75ee69244d988827d27b5db33edc 2023-11-03 13:56:46,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/f5f065a96fd84fe8a7589df0e32abfbf 2023-11-03 13:56:47,407 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103bc6f34dd2caa435a91046ecfdb2c0864_del 2023-11-03 13:56:47,407 INFO [Listener at localhost/39963] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231103bc6f34dd2caa435a91046ecfdb2c0864_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231103bc6f34dd2caa435a91046ecfdb2c0864_del 2023-11-03 13:56:47,849 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87a0c7baec0d4a3297d232fa66ad24f2 2023-11-03 13:56:47,850 DEBUG [Listener at localhost/39963] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/.tmp/family2/87a0c7baec0d4a3297d232fa66ad24f2 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/87a0c7baec0d4a3297d232fa66ad24f2 2023-11-03 13:56:47,854 INFO [Listener at localhost/39963] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87a0c7baec0d4a3297d232fa66ad24f2 2023-11-03 13:56:47,855 INFO [Listener at localhost/39963] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7dcaa53e14ef59d58a71971a814fc4cc/family2 of 7dcaa53e14ef59d58a71971a814fc4cc into 87a0c7baec0d4a3297d232fa66ad24f2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-03 13:56:47,856 DEBUG [Listener at localhost/39963] regionserver.HRegion(2289): Compaction status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:47,862 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:47,866 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:47,880 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:47,881 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:47,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee] to archive 2023-11-03 13:56:47,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:47,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/647482eea51d4cd3b2153efa92c7105a 2023-11-03 13:56:47,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/59d3bd28a2544c28b725837d37ca1a3a 2023-11-03 13:56:47,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/795d5830340548d480eb047a64b08869 2023-11-03 13:56:47,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/2835979a8f0f4f5296847667f443489e 2023-11-03 13:56:47,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family2/669f0ea491b84d20ad0b088a2ffad1ee 2023-11-03 13:56:47,905 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45993] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10LS\x0D\xC6\x0E\xF7@*iZU\x10\xAD\xB6uJ"\x10\xD1\x184}o?O\xE2\xA3\xA4\x1A\x0C\x1C\xD3\x8C\xBC*\x10\xA2$7"d\xB2!}!\x97\xE1\xC1\xAC8a\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-03 13:56:47,940 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-03 13:56:47,947 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-03 13:56:47,951 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699020407951 2023-11-03 13:56:47,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:56:47,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-03 13:56:48,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-03 13:56:48,447 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del 2023-11-03 13:56:48,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del 2023-11-03 13:56:48,522 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del 2023-11-03 13:56:48,522 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:48,523 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] zookeeper.ReadOnlyZKClient(139): Connect 0x514820f4 to 127.0.0.1:53668 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-03 13:56:48,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9e25c6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-03 13:56:48,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:49,214 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311034af419e7f04a409bace44ed1cfb0a884 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311034af419e7f04a409bace44ed1cfb0a884 2023-11-03 13:56:49,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:49,231 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-03 13:56:49,233 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-03 13:56:49,252 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-03 13:56:49,255 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-03 13:56:49,312 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231103/family1/3a6e0239062442618401a05803ed8520 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-03 13:56:49,316 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231103/family1/3a6e0239062442618401a05803ed8520}] 2023-11-03 13:56:49,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231103/family1/3a6e0239062442618401a05803ed8520 for inclusion in 7dcaa53e14ef59d58a71971a814fc4cc/family1 2023-11-03 13:56:49,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-03 13:56:49,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-03 13:56:49,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:49,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231103/family1/3a6e0239062442618401a05803ed8520 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__u3no3js28mdgfvt1ek7osq2bj9aqah65khd5tj4no6grncnip7cj5q1lghgn5tjr/family1/3a6e0239062442618401a05803ed8520 2023-11-03 13:56:49,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__u3no3js28mdgfvt1ek7osq2bj9aqah65khd5tj4no6grncnip7cj5q1lghgn5tjr/family1/3a6e0239062442618401a05803ed8520 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/c66a071a4a104b7e9906551f041501cc_SeqId_28_ 2023-11-03 13:56:49,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__u3no3js28mdgfvt1ek7osq2bj9aqah65khd5tj4no6grncnip7cj5q1lghgn5tjr/family1/3a6e0239062442618401a05803ed8520 into 7dcaa53e14ef59d58a71971a814fc4cc/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/c66a071a4a104b7e9906551f041501cc_SeqId_28_ - updating store file list. 2023-11-03 13:56:49,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/c66a071a4a104b7e9906551f041501cc_SeqId_28_ into 7dcaa53e14ef59d58a71971a814fc4cc/family1 2023-11-03 13:56:49,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__u3no3js28mdgfvt1ek7osq2bj9aqah65khd5tj4no6grncnip7cj5q1lghgn5tjr/family1/3a6e0239062442618401a05803ed8520 into 7dcaa53e14ef59d58a71971a814fc4cc/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/family1/c66a071a4a104b7e9906551f041501cc_SeqId_28_) 2023-11-03 13:56:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__u3no3js28mdgfvt1ek7osq2bj9aqah65khd5tj4no6grncnip7cj5q1lghgn5tjr/family1/3a6e0239062442618401a05803ed8520 2023-11-03 13:56:49,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:49,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:49,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103473c03a06c494285a99f0b8037b22163 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103473c03a06c494285a99f0b8037b22163 2023-11-03 13:56:49,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035c653d5dfd19428390065ca8a42b7de7 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035c653d5dfd19428390065ca8a42b7de7 2023-11-03 13:56:49,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035e22ceb425514634a89ae865f7e706d3 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311035e22ceb425514634a89ae865f7e706d3 2023-11-03 13:56:49,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311038e4e379a64fe4ecb9f1c7d85ddc36049 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311038e4e379a64fe4ecb9f1c7d85ddc36049 2023-11-03 13:56:49,514 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-03 13:56:49,514 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231103' 2023-11-03 13:56:49,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:49,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:50,256 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311038a6f8797f351493f8332491386e60130 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311038a6f8797f351493f8332491386e60130 2023-11-03 13:56:50,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:50,377 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-03 13:56:50,401 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231103/family1/75d8929131134882b71fbaeba2acc709 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-03 13:56:50,402 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231103/family1/75d8929131134882b71fbaeba2acc709}] 2023-11-03 13:56:50,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231103/family1/75d8929131134882b71fbaeba2acc709 for inclusion in ecc419573e8aff484d42f90a993a2398/family1 2023-11-03 13:56:50,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-03 13:56:50,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first= last=1 2023-11-03 13:56:50,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:50,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231103/family1/75d8929131134882b71fbaeba2acc709 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__k276d8936b13otq5podbh5b7sm3ssi2rkdbb4sj5to74bid16bq6jqkhmjkhf6q5/family1/75d8929131134882b71fbaeba2acc709 2023-11-03 13:56:50,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__k276d8936b13otq5podbh5b7sm3ssi2rkdbb4sj5to74bid16bq6jqkhmjkhf6q5/family1/75d8929131134882b71fbaeba2acc709 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/dafc627ced0f4c84a128139828c25644_SeqId_28_ 2023-11-03 13:56:50,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__k276d8936b13otq5podbh5b7sm3ssi2rkdbb4sj5to74bid16bq6jqkhmjkhf6q5/family1/75d8929131134882b71fbaeba2acc709 into ecc419573e8aff484d42f90a993a2398/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/dafc627ced0f4c84a128139828c25644_SeqId_28_ - updating store file list. 2023-11-03 13:56:50,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/dafc627ced0f4c84a128139828c25644_SeqId_28_ into ecc419573e8aff484d42f90a993a2398/family1 2023-11-03 13:56:50,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__k276d8936b13otq5podbh5b7sm3ssi2rkdbb4sj5to74bid16bq6jqkhmjkhf6q5/family1/75d8929131134882b71fbaeba2acc709 into ecc419573e8aff484d42f90a993a2398/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/family1/dafc627ced0f4c84a128139828c25644_SeqId_28_) 2023-11-03 13:56:50,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__k276d8936b13otq5podbh5b7sm3ssi2rkdbb4sj5to74bid16bq6jqkhmjkhf6q5/family1/75d8929131134882b71fbaeba2acc709 2023-11-03 13:56:50,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:50,538 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:50,547 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110318a65a82f6cc4784be1177410d216eab to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110318a65a82f6cc4784be1177410d216eab 2023-11-03 13:56:50,549 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103421267fb92a14351a759338917b3c0af to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103421267fb92a14351a759338917b3c0af 2023-11-03 13:56:50,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103683dee6065884ab9ba3f10266882a6ae to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103683dee6065884ab9ba3f10266882a6ae 2023-11-03 13:56:50,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103f148dfbefe9f49dcb989fb7b9389416b to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103f148dfbefe9f49dcb989fb7b9389416b 2023-11-03 13:56:50,552 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-03 13:56:50,552 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231103' 2023-11-03 13:56:50,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:50,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:51,644 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110388e22630abb941ad9c03e0c6fbc20cd2 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110388e22630abb941ad9c03e0c6fbc20cd2 2023-11-03 13:56:51,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:51,699 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231103/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-03 13:56:51,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b., hostname=jenkins-hbase20.apache.org,46707,1699019650288, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231103/family1/9db9ba5687c74faf9c5a1c9a9affa0a5}] 2023-11-03 13:56:51,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(763): Validating hfile at hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231103/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 for inclusion in 11eb07e0192fd9953208b402ac78964b/family1 2023-11-03 13:56:51,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-03 13:56:51,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-03 13:56:51,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(2446): Flush status journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:51,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231103/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__dlk3944ksro15aot3ebtvpgjkkkufbumgk1ql3bc16bna0gltr1e67ejjke577vo/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 2023-11-03 13:56:51,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__dlk3944ksro15aot3ebtvpgjkkkufbumgk1ql3bc16bna0gltr1e67ejjke577vo/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/caa0f9c7c4ba449a852cfa5820296748_SeqId_28_ 2023-11-03 13:56:51,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(849): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__dlk3944ksro15aot3ebtvpgjkkkufbumgk1ql3bc16bna0gltr1e67ejjke577vo/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 into 11eb07e0192fd9953208b402ac78964b/family1 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/caa0f9c7c4ba449a852cfa5820296748_SeqId_28_ - updating store file list. 2023-11-03 13:56:51,742 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-03 13:56:51,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(882): Loaded HFile hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/caa0f9c7c4ba449a852cfa5820296748_SeqId_28_ into 11eb07e0192fd9953208b402ac78964b/family1 2023-11-03 13:56:51,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HStore(855): Successfully loaded hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__dlk3944ksro15aot3ebtvpgjkkkufbumgk1ql3bc16bna0gltr1e67ejjke577vo/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 into 11eb07e0192fd9953208b402ac78964b/family1 (new location: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/family1/caa0f9c7c4ba449a852cfa5820296748_SeqId_28_) 2023-11-03 13:56:51,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/staging/jenkins__testMajorCompactionFromAdmin__dlk3944ksro15aot3ebtvpgjkkkufbumgk1ql3bc16bna0gltr1e67ejjke577vo/family1/9db9ba5687c74faf9c5a1c9a9affa0a5 2023-11-03 13:56:51,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231103 table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:51,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:51,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311033a995cfac1ba415cbac899a4e9ba3660 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311033a995cfac1ba415cbac899a4e9ba3660 2023-11-03 13:56:51,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103601e5b5cbc6b4539bc5b0b4360bada98 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103601e5b5cbc6b4539bc5b0b4360bada98 2023-11-03 13:56:51,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311038547250def944e4ca8b0f60111873994 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311038547250def944e4ca8b0f60111873994 2023-11-03 13:56:51,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103d70b239c9a864659b5cc57f45fa21fe1 to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103d70b239c9a864659b5cc57f45fa21fe1 2023-11-03 13:56:51,762 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-03 13:56:51,762 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231103' 2023-11-03 13:56:51,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231103 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:51,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-03 13:56:51,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-03 13:56:51,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del] 2023-11-03 13:56:51,763 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:51,764 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231103ed07980145824b63a7b897a468456e18_del 2023-11-03 13:56:51,764 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-03 13:56:51,764 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del] 2023-11-03 13:56:51,765 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:51,766 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231103c04798eaa7c64e298c54c98edf85761d_del 2023-11-03 13:56:51,766 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-03 13:56:51,766 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del] 2023-11-03 13:56:51,766 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(360): Archiving compacted files. 2023-11-03 13:56:51,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del to hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231103bcbb45712f244bf1aab41df18f7a6819_del 2023-11-03 13:56:51,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-03 13:56:51,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699019656798] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-03 13:56:51,769 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-03 13:56:51,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.8320 sec 2023-11-03 13:56:51,784 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:51,787 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:51,789 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-03 13:56:51,790 DEBUG [Listener at localhost/39963] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-03 13:56:51,797 INFO [Listener at localhost/39963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-03 13:56:51,842 INFO [Listener at localhost/39963] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 259), OpenFileDescriptor=675 (was 687), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1110 (was 1136), ProcessCount=195 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1191 (was 267) - AvailableMemoryMB LEAK? - 2023-11-03 13:56:51,843 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1404b169 to 127.0.0.1:53668 2023-11-03 13:56:51,843 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:51,843 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-03 13:56:51,843 INFO [Listener at localhost/39963] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-03 13:56:51,843 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b326aed to 127.0.0.1:53668 2023-11-03 13:56:51,843 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:51,844 DEBUG [Listener at localhost/39963] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-03 13:56:51,845 DEBUG [Listener at localhost/39963] util.JVMClusterUtil(257): Found active master hash=1236422388, stopped=false 2023-11-03 13:56:51,845 INFO [Listener at localhost/39963] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:56:51,846 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-03 13:56:51,846 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-03 13:56:51,846 INFO [Listener at localhost/39963] procedure2.ProcedureExecutor(628): Stopping 2023-11-03 13:56:51,846 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:56:51,846 DEBUG [Listener at localhost/39963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4214424e to 127.0.0.1:53668 2023-11-03 13:56:51,847 DEBUG [Listener at localhost/39963] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:51,847 INFO [Listener at localhost/39963] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,46707,1699019650288' ***** 2023-11-03 13:56:51,847 INFO [Listener at localhost/39963] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-03 13:56:51,847 INFO [RS:0;jenkins-hbase20:46707] regionserver.HeapMemoryManager(220): Stopping 2023-11-03 13:56:51,847 INFO [RS:0;jenkins-hbase20:46707] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-03 13:56:51,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-03 13:56:51,847 INFO [RS:0;jenkins-hbase20:46707] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-03 13:56:51,847 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-03 13:56:51,848 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for be67baf7df661516c1e6c1e7f11a0c3a 2023-11-03 13:56:51,848 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for dea5da2d9fa5173fe36f181ac69bffb2 2023-11-03 13:56:51,848 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 11eb07e0192fd9953208b402ac78964b 2023-11-03 13:56:51,848 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for ecc419573e8aff484d42f90a993a2398 2023-11-03 13:56:51,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-03 13:56:51,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing be67baf7df661516c1e6c1e7f11a0c3a, disabling compactions & flushes 2023-11-03 13:56:51,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:56:51,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:56:51,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. after waiting 0 ms 2023-11-03 13:56:51,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 9ff818d7ca8c39b008fd99234a4e0bee 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 7b948d6a87719f2b1cc30a04e963f90d 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 267647d419eb66138024b911f3fdb709 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 7fff8698e9e97b529f7baca6d3aa3f86 2023-11-03 13:56:51,849 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for cb8d8f1509b262c97e50f80367a86aa1 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for c1895869427f29144d076bec60ad1ba7 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 38279015a373f34c66be1e5fe643de64 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for c1dc363b0a4a8bd24f43f4db8cf648a2 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 46cdc5862837157d20f70fafedc327bc 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 31de55707a073f93015ed03c91cb49dc 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 9698b8a3cd29c99df62020ad84c00ed5 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for aaa7e5a05e5ae46b673f2a4aa2c44abf 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for a914db93780e65775c574379b67493d2 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 7dcaa53e14ef59d58a71971a814fc4cc 2023-11-03 13:56:51,850 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:51,850 DEBUG [RS:0;jenkins-hbase20:46707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65c744bb to 127.0.0.1:53668 2023-11-03 13:56:51,850 DEBUG [RS:0;jenkins-hbase20:46707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:51,851 INFO [RS:0;jenkins-hbase20:46707] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-03 13:56:51,851 INFO [RS:0;jenkins-hbase20:46707] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-03 13:56:51,851 INFO [RS:0;jenkins-hbase20:46707] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-03 13:56:51,851 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-03 13:56:51,854 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-03 13:56:51,855 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1504): Waiting on 11eb07e0192fd9953208b402ac78964b, 1588230740, 267647d419eb66138024b911f3fdb709, 31de55707a073f93015ed03c91cb49dc, 38279015a373f34c66be1e5fe643de64, 46cdc5862837157d20f70fafedc327bc, 7b948d6a87719f2b1cc30a04e963f90d, 7dcaa53e14ef59d58a71971a814fc4cc, 7fff8698e9e97b529f7baca6d3aa3f86, 9698b8a3cd29c99df62020ad84c00ed5, 9ff818d7ca8c39b008fd99234a4e0bee, a914db93780e65775c574379b67493d2, aaa7e5a05e5ae46b673f2a4aa2c44abf, be67baf7df661516c1e6c1e7f11a0c3a, c1895869427f29144d076bec60ad1ba7, c1dc363b0a4a8bd24f43f4db8cf648a2, c349b5a83940e7ac1020a6ff54953bba, cb8d8f1509b262c97e50f80367a86aa1, dea5da2d9fa5173fe36f181ac69bffb2, ecc419573e8aff484d42f90a993a2398, f7a69c8b2f27947fa780cdacad82aecf 2023-11-03 13:56:51,855 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-03 13:56:51,856 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-03 13:56:51,856 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-03 13:56:51,856 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-03 13:56:51,856 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-03 13:56:51,856 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-11-03 13:56:51,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/be67baf7df661516c1e6c1e7f11a0c3a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-03 13:56:51,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:56:51,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for be67baf7df661516c1e6c1e7f11a0c3a: 2023-11-03 13:56:51,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699019695748.be67baf7df661516c1e6c1e7f11a0c3a. 2023-11-03 13:56:51,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing dea5da2d9fa5173fe36f181ac69bffb2, disabling compactions & flushes 2023-11-03 13:56:51,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:56:51,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:56:51,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. after waiting 0 ms 2023-11-03 13:56:51,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:56:51,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/dea5da2d9fa5173fe36f181ac69bffb2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-03 13:56:51,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for dea5da2d9fa5173fe36f181ac69bffb2: 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699019695748.dea5da2d9fa5173fe36f181ac69bffb2. 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 11eb07e0192fd9953208b402ac78964b, disabling compactions & flushes 2023-11-03 13:56:51,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. after waiting 0 ms 2023-11-03 13:56:51,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:51,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/info/8e803d13e1574e5ba468ca90fe4db77f 2023-11-03 13:56:51,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/11eb07e0192fd9953208b402ac78964b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:51,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 11eb07e0192fd9953208b402ac78964b: 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699019791998.11eb07e0192fd9953208b402ac78964b. 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ecc419573e8aff484d42f90a993a2398, disabling compactions & flushes 2023-11-03 13:56:51,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. after waiting 0 ms 2023-11-03 13:56:51,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:51,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e803d13e1574e5ba468ca90fe4db77f 2023-11-03 13:56:51,883 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-03 13:56:51,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/ecc419573e8aff484d42f90a993a2398/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:51,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ecc419573e8aff484d42f90a993a2398: 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699019791998.ecc419573e8aff484d42f90a993a2398. 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f7a69c8b2f27947fa780cdacad82aecf, disabling compactions & flushes 2023-11-03 13:56:51,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. after waiting 0 ms 2023-11-03 13:56:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:56:51,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithWeeklyPolicy/f7a69c8b2f27947fa780cdacad82aecf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-03 13:56:51,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:56:51,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f7a69c8b2f27947fa780cdacad82aecf: 2023-11-03 13:56:51,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699019682995.f7a69c8b2f27947fa780cdacad82aecf. 2023-11-03 13:56:51,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9ff818d7ca8c39b008fd99234a4e0bee, disabling compactions & flushes 2023-11-03 13:56:51,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:56:51,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:56:51,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. after waiting 0 ms 2023-11-03 13:56:51,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:56:51,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/rep_barrier/04c6681345dd4aa69a3b9c512ab83733 2023-11-03 13:56:51,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9ff818d7ca8c39b008fd99234a4e0bee/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-03 13:56:51,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:56:51,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9ff818d7ca8c39b008fd99234a4e0bee: 2023-11-03 13:56:51,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699019719974.9ff818d7ca8c39b008fd99234a4e0bee. 2023-11-03 13:56:51,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7b948d6a87719f2b1cc30a04e963f90d, disabling compactions & flushes 2023-11-03 13:56:51,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:51,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:51,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. after waiting 0 ms 2023-11-03 13:56:51,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:51,912 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04c6681345dd4aa69a3b9c512ab83733 2023-11-03 13:56:51,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/7b948d6a87719f2b1cc30a04e963f90d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:51,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7b948d6a87719f2b1cc30a04e963f90d: 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699019762173.7b948d6a87719f2b1cc30a04e963f90d. 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 267647d419eb66138024b911f3fdb709, disabling compactions & flushes 2023-11-03 13:56:51,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. after waiting 0 ms 2023-11-03 13:56:51,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:51,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/table/781fbd5f18884ab78e1a7c538a8bd0af 2023-11-03 13:56:51,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMinorCompactionWithMonthlyPolicy/267647d419eb66138024b911f3fdb709/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-03 13:56:51,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:51,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 267647d419eb66138024b911f3fdb709: 2023-11-03 13:56:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699019779219.267647d419eb66138024b911f3fdb709. 2023-11-03 13:56:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7fff8698e9e97b529f7baca6d3aa3f86, disabling compactions & flushes 2023-11-03 13:56:51,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:56:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:56:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. after waiting 0 ms 2023-11-03 13:56:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:56:51,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 781fbd5f18884ab78e1a7c538a8bd0af 2023-11-03 13:56:51,933 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-03 13:56:51,933 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-03 13:56:51,933 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-03 13:56:51,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testScannerOnBulkLoadRefHFiles/7fff8698e9e97b529f7baca6d3aa3f86/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-03 13:56:51,934 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/info/8e803d13e1574e5ba468ca90fe4db77f as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/info/8e803d13e1574e5ba468ca90fe4db77f 2023-11-03 13:56:51,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:56:51,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7fff8698e9e97b529f7baca6d3aa3f86: 2023-11-03 13:56:51,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699019695748.7fff8698e9e97b529f7baca6d3aa3f86. 2023-11-03 13:56:51,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cb8d8f1509b262c97e50f80367a86aa1, disabling compactions & flushes 2023-11-03 13:56:51,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:51,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:51,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. after waiting 0 ms 2023-11-03 13:56:51,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:51,946 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-03 13:56:51,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e803d13e1574e5ba468ca90fe4db77f 2023-11-03 13:56:51,948 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/info/8e803d13e1574e5ba468ca90fe4db77f, entries=226, sequenceid=130, filesize=37.9 K 2023-11-03 13:56:51,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/rep_barrier/04c6681345dd4aa69a3b9c512ab83733 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/rep_barrier/04c6681345dd4aa69a3b9c512ab83733 2023-11-03 13:56:51,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/cb8d8f1509b262c97e50f80367a86aa1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:51,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:51,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cb8d8f1509b262c97e50f80367a86aa1: 2023-11-03 13:56:51,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699019762173.cb8d8f1509b262c97e50f80367a86aa1. 2023-11-03 13:56:51,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c1895869427f29144d076bec60ad1ba7, disabling compactions & flushes 2023-11-03 13:56:51,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:51,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:51,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. after waiting 0 ms 2023-11-03 13:56:51,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:51,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04c6681345dd4aa69a3b9c512ab83733 2023-11-03 13:56:51,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c1895869427f29144d076bec60ad1ba7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-03 13:56:51,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/rep_barrier/04c6681345dd4aa69a3b9c512ab83733, entries=1, sequenceid=130, filesize=5.0 K 2023-11-03 13:56:51,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c1895869427f29144d076bec60ad1ba7: 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699019737832.c1895869427f29144d076bec60ad1ba7. 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 38279015a373f34c66be1e5fe643de64, disabling compactions & flushes 2023-11-03 13:56:51,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. after waiting 0 ms 2023-11-03 13:56:51,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:56:51,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/.tmp/table/781fbd5f18884ab78e1a7c538a8bd0af as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/table/781fbd5f18884ab78e1a7c538a8bd0af 2023-11-03 13:56:51,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/38279015a373f34c66be1e5fe643de64/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-03 13:56:51,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:56:51,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 38279015a373f34c66be1e5fe643de64: 2023-11-03 13:56:51,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699019657187.38279015a373f34c66be1e5fe643de64. 2023-11-03 13:56:51,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c1dc363b0a4a8bd24f43f4db8cf648a2, disabling compactions & flushes 2023-11-03 13:56:51,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:51,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:51,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. after waiting 0 ms 2023-11-03 13:56:51,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:51,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 781fbd5f18884ab78e1a7c538a8bd0af 2023-11-03 13:56:51,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/table/781fbd5f18884ab78e1a7c538a8bd0af, entries=27, sequenceid=130, filesize=6.6 K 2023-11-03 13:56:51,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 131ms, sequenceid=130, compaction requested=false 2023-11-03 13:56:52,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/ns/testMinorCompaction/c1dc363b0a4a8bd24f43f4db8cf648a2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:52,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c1dc363b0a4a8bd24f43f4db8cf648a2: 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699019762173.c1dc363b0a4a8bd24f43f4db8cf648a2. 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 46cdc5862837157d20f70fafedc327bc, disabling compactions & flushes 2023-11-03 13:56:52,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. after waiting 0 ms 2023-11-03 13:56:52,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:52,034 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-03 13:56:52,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-03 13:56:52,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-03 13:56:52,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-03 13:56:52,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-03 13:56:52,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/46cdc5862837157d20f70fafedc327bc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-03 13:56:52,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:52,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 46cdc5862837157d20f70fafedc327bc: 2023-11-03 13:56:52,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699019737832.46cdc5862837157d20f70fafedc327bc. 2023-11-03 13:56:52,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 31de55707a073f93015ed03c91cb49dc, disabling compactions & flushes 2023-11-03 13:56:52,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:56:52,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:56:52,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. after waiting 0 ms 2023-11-03 13:56:52,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:56:52,056 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1504): Waiting on 31de55707a073f93015ed03c91cb49dc, 7dcaa53e14ef59d58a71971a814fc4cc, 9698b8a3cd29c99df62020ad84c00ed5, a914db93780e65775c574379b67493d2, aaa7e5a05e5ae46b673f2a4aa2c44abf, c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:52,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithMonthlyPolicy/31de55707a073f93015ed03c91cb49dc/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-11-03 13:56:52,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 31de55707a073f93015ed03c91cb49dc: 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699019672144.31de55707a073f93015ed03c91cb49dc. 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9698b8a3cd29c99df62020ad84c00ed5, disabling compactions & flushes 2023-11-03 13:56:52,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. after waiting 0 ms 2023-11-03 13:56:52,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:56:52,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyPolicy/9698b8a3cd29c99df62020ad84c00ed5/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-03 13:56:52,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9698b8a3cd29c99df62020ad84c00ed5: 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699019699610.9698b8a3cd29c99df62020ad84c00ed5. 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aaa7e5a05e5ae46b673f2a4aa2c44abf, disabling compactions & flushes 2023-11-03 13:56:52,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. after waiting 0 ms 2023-11-03 13:56:52,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:56:52,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing aaa7e5a05e5ae46b673f2a4aa2c44abf 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-03 13:56:52,256 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1504): Waiting on 7dcaa53e14ef59d58a71971a814fc4cc, a914db93780e65775c574379b67493d2, aaa7e5a05e5ae46b673f2a4aa2c44abf, c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:52,456 DEBUG [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1504): Waiting on 7dcaa53e14ef59d58a71971a814fc4cc, a914db93780e65775c574379b67493d2, aaa7e5a05e5ae46b673f2a4aa2c44abf, c349b5a83940e7ac1020a6ff54953bba 2023-11-03 13:56:52,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/.tmp/info/b9168fe5053c43adba25c6a5690015dc 2023-11-03 13:56:52,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/.tmp/info/b9168fe5053c43adba25c6a5690015dc as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/info/b9168fe5053c43adba25c6a5690015dc 2023-11-03 13:56:52,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/info/b9168fe5053c43adba25c6a5690015dc, entries=3, sequenceid=7, filesize=4.8 K 2023-11-03 13:56:52,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for aaa7e5a05e5ae46b673f2a4aa2c44abf in 433ms, sequenceid=7, compaction requested=false 2023-11-03 13:56:52,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/hbase/namespace/aaa7e5a05e5ae46b673f2a4aa2c44abf/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-03 13:56:52,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aaa7e5a05e5ae46b673f2a4aa2c44abf: 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699019655391.aaa7e5a05e5ae46b673f2a4aa2c44abf. 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c349b5a83940e7ac1020a6ff54953bba, disabling compactions & flushes 2023-11-03 13:56:52,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. after waiting 0 ms 2023-11-03 13:56:52,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:52,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testCompactionWithHFileLink/c349b5a83940e7ac1020a6ff54953bba/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-03 13:56:52,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c349b5a83940e7ac1020a6ff54953bba: 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699019737832.c349b5a83940e7ac1020a6ff54953bba. 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a914db93780e65775c574379b67493d2, disabling compactions & flushes 2023-11-03 13:56:52,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. after waiting 0 ms 2023-11-03 13:56:52,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:56:52,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a914db93780e65775c574379b67493d2/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-03 13:56:52,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a914db93780e65775c574379b67493d2: 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699019706886.a914db93780e65775c574379b67493d2. 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7dcaa53e14ef59d58a71971a814fc4cc, disabling compactions & flushes 2023-11-03 13:56:52,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. after waiting 0 ms 2023-11-03 13:56:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:52,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/data/default/testMajorCompactionFromAdmin/7dcaa53e14ef59d58a71971a814fc4cc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-03 13:56:52,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:52,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7dcaa53e14ef59d58a71971a814fc4cc: 2023-11-03 13:56:52,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699019791998.7dcaa53e14ef59d58a71971a814fc4cc. 2023-11-03 13:56:52,656 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,46707,1699019650288; all regions closed. 2023-11-03 13:56:52,664 DEBUG [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/oldWALs 2023-11-03 13:56:52,664 INFO [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46707%2C1699019650288.meta:.meta(num 1699019654695) 2023-11-03 13:56:52,670 DEBUG [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/oldWALs 2023-11-03 13:56:52,670 INFO [RS:0;jenkins-hbase20:46707] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46707%2C1699019650288:(num 1699019654082) 2023-11-03 13:56:52,670 DEBUG [RS:0;jenkins-hbase20:46707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:52,670 INFO [RS:0;jenkins-hbase20:46707] regionserver.LeaseManager(133): Closed leases 2023-11-03 13:56:52,671 INFO [RS:0;jenkins-hbase20:46707] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-03 13:56:52,671 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-03 13:56:52,672 INFO [RS:0;jenkins-hbase20:46707] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46707 2023-11-03 13:56:52,682 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46707,1699019650288 2023-11-03 13:56:52,682 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-03 13:56:52,682 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-03 13:56:52,683 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46707,1699019650288] 2023-11-03 13:56:52,684 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46707,1699019650288; numProcessing=1 2023-11-03 13:56:52,687 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46707,1699019650288 already deleted, retry=false 2023-11-03 13:56:52,687 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,46707,1699019650288 expired; onlineServers=0 2023-11-03 13:56:52,687 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,45993,1699019647783' ***** 2023-11-03 13:56:52,687 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-03 13:56:52,688 DEBUG [M:0;jenkins-hbase20:45993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@88f44cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-03 13:56:52,688 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,45993,1699019647783 2023-11-03 13:56:52,688 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,45993,1699019647783; all regions closed. 2023-11-03 13:56:52,688 DEBUG [M:0;jenkins-hbase20:45993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-03 13:56:52,688 DEBUG [M:0;jenkins-hbase20:45993] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-03 13:56:52,689 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-03 13:56:52,689 DEBUG [M:0;jenkins-hbase20:45993] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-03 13:56:52,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699019653719] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699019653719,5,FailOnTimeoutGroup] 2023-11-03 13:56:52,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699019653723] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699019653723,5,FailOnTimeoutGroup] 2023-11-03 13:56:52,689 INFO [M:0;jenkins-hbase20:45993] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-03 13:56:52,689 INFO [M:0;jenkins-hbase20:45993] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-03 13:56:52,689 INFO [M:0;jenkins-hbase20:45993] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-11-03 13:56:52,690 DEBUG [M:0;jenkins-hbase20:45993] master.HMaster(1512): Stopping service threads 2023-11-03 13:56:52,690 INFO [M:0;jenkins-hbase20:45993] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-03 13:56:52,690 ERROR [M:0;jenkins-hbase20:45993] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-03 13:56:52,690 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-03 13:56:52,690 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-03 13:56:52,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-03 13:56:52,691 INFO [M:0;jenkins-hbase20:45993] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-03 13:56:52,691 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-03 13:56:52,691 DEBUG [M:0;jenkins-hbase20:45993] zookeeper.ZKUtil(398): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-03 13:56:52,691 WARN [M:0;jenkins-hbase20:45993] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-03 13:56:52,691 INFO [M:0;jenkins-hbase20:45993] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-03 13:56:52,692 INFO [M:0;jenkins-hbase20:45993] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-03 13:56:52,692 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-03 13:56:52,692 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:56:52,692 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:56:52,692 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-03 13:56:52,692 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:56:52,692 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.21 KB heapSize=599.38 KB 2023-11-03 13:56:52,702 INFO [M:0;jenkins-hbase20:45993] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.21 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d83a1f3967eb413385bd1d241a016ce8 2023-11-03 13:56:52,707 INFO [M:0;jenkins-hbase20:45993] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d83a1f3967eb413385bd1d241a016ce8 2023-11-03 13:56:52,708 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d83a1f3967eb413385bd1d241a016ce8 as hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d83a1f3967eb413385bd1d241a016ce8 2023-11-03 13:56:52,712 INFO [M:0;jenkins-hbase20:45993] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d83a1f3967eb413385bd1d241a016ce8 2023-11-03 13:56:52,712 INFO [M:0;jenkins-hbase20:45993] regionserver.HStore(1080): Added hdfs://localhost:35135/user/jenkins/test-data/06c474f6-d479-dbac-c055-602da00270b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d83a1f3967eb413385bd1d241a016ce8, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-03 13:56:52,712 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegion(2948): Finished flush of dataSize ~513.21 KB/525530, heapSize ~599.36 KB/613744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=1011, compaction requested=false 2023-11-03 13:56:52,713 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-03 13:56:52,713 DEBUG [M:0;jenkins-hbase20:45993] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-03 13:56:52,716 INFO [M:0;jenkins-hbase20:45993] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-03 13:56:52,716 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-03 13:56:52,717 INFO [M:0;jenkins-hbase20:45993] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45993 2023-11-03 13:56:52,721 DEBUG [M:0;jenkins-hbase20:45993] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,45993,1699019647783 already deleted, retry=false 2023-11-03 13:56:52,787 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-03 13:56:52,787 INFO [RS:0;jenkins-hbase20:46707] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,46707,1699019650288; zookeeper connection closed. 2023-11-03 13:56:52,787 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x10197b936ac0001, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-03 13:56:52,788 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@48d865e7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@48d865e7 2023-11-03 13:56:52,788 INFO [Listener at localhost/39963] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-03 13:56:52,822 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-03 13:56:52,822 INFO [M:0;jenkins-hbase20:45993] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,45993,1699019647783; zookeeper connection closed. 2023-11-03 13:56:52,822 DEBUG [Listener at localhost/39963-EventThread] zookeeper.ZKWatcher(600): master:45993-0x10197b936ac0000, quorum=127.0.0.1:53668, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-03 13:56:52,824 WARN [Listener at localhost/39963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-03 13:56:52,831 INFO [Listener at localhost/39963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-03 13:56:52,841 WARN [BP-1253986852-148.251.75.209-1699019640487 heartbeating to localhost/127.0.0.1:35135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-03 13:56:52,842 WARN [BP-1253986852-148.251.75.209-1699019640487 heartbeating to localhost/127.0.0.1:35135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1253986852-148.251.75.209-1699019640487 (Datanode Uuid 7ee4b17e-5547-4b38-9c91-4ae2fa68c6fd) service to localhost/127.0.0.1:35135 2023-11-03 13:56:52,845 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/dfs/data/data1/current/BP-1253986852-148.251.75.209-1699019640487] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-03 13:56:52,845 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/774b7d97-6604-ec6c-3e17-73569a1544b2/cluster_5033d27f-d091-c30c-abcf-30733963f9c1/dfs/data/data2/current/BP-1253986852-148.251.75.209-1699019640487] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-03 13:56:52,890 INFO [Listener at localhost/39963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-03 13:56:53,039 INFO [Listener at localhost/39963] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-03 13:56:53,146 INFO [Listener at localhost/39963] hbase.HBaseTestingUtility(1293): Minicluster is down